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LANE DEVIATION ALARM SYSTEM 
BACKGROUND OF THE INVENTION 

[0001] The present invention relates to a lane 
deviation alarm system which generates an alarm 
5 indicative of a deviation of a vehicle from a traveling 
lane, on the basis of a picked-up image showing both lane 
defining lines of the traveling lane on a road. 
[0002] Japanese Published Patent Application No. 2002- 
193055 discloses a lane deviation alarm system which 

10 informs a driver that a host vehicle deviates from a 

traveling lane by generating. an alarm. More specifically, 
this lane deviation alarm system comprises an image 
picking-up section for picking up lane defining lines 
(white lines) of a traveling lane on a road, a yaw angle 

15 detecting section for obtaining a yaw angle of the host 

vehicle relative to the road, a road curvature estimating 
section for estimating a forward road curvature on the 
basis of an image picked up by the image picking-up 
section, a traveling curvature estimating section for 

20 estimating a traveling curvature from a traveling 
condition of the host vehicle, a lane deviation 
determining section for determining a lane deviation of 
the host vehicle on the basis of the information of a 
traveling road and the vehicle position, and an informing 

25 section for informing a lane deviation possibility to a 
driver when the host vehicle deviates from the traveling 
lane. 

SUMMARY OF THE INVENTION 

[0003] In case that the lane deviation is anticipated 
30 using a picked-up image indicative of lane defining lines, 
when only one of lane defining lines is detected, an 
estimation error of a vehicle position increases and 
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therefore erroneous alarms tend to be generated. For 
example, when only one of lane defining lines is detected, 
a yaw angle of the host vehicle is erroneously estimated 
and largely fluctuates due to various factors such as a 
vehicle pitching. Consequently, an estimation error of 
the vehicle position relative to the traveling lane 
largely increases so as to tend to generate erroneous 
alarms. Herein, a situation that one of lane defining 
lines is detected includes a location limit such that 
lane defining line exists at only one side, such as at a 
splitting or merging lane on a highway, and a 
non-detection state of one lane defining line which is 
caused by Botts Dots or patchy looking of the 
lane-def ining-line . 

[0004] On the other hand, if the alarm is arranged to 
be temporally stopped in case that a non-detection state 
of one or both lane defining lines continues for a 
predetermined time, a rate of a system operation time 
decreases and therefore the validity of the system 
degrades. Further, if a sensibility of generating alarm 
is lowered while setting an alarm generating threshold at 
a high value, the alarm generation time delays although 
the frequency of the erroneous alarms decreases . 
[0005] It is therefore an object of the present 
invention to provide an improved lane deviation alarm 
system which is capable of decreasing the frequency of 
erroneous alarms even when only one of both lane defining 
lines is detected. 

[0006] An aspect of the present invention resides a 
lane deviation alarm system which comprises a lane 
defining line detecting section that detects a lane 
defining line of a lane traveled by a host vehicle; and a 
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criteria changing section that changes a criteria for 
determining a lane deviation tendency of the host vehicle, 
on the basis of a detecting condition of the lane 
defining line. 

5 [0007] Another aspect of the present invention resides 
in a method of generating an alarm when a lane deviation 
tendency of a host vehicle is determined, which method 
comprises an operation of detecting a lane defining line 
of a lane traveled by a host vehicle; and an operation of 

lo changing a criteria for determining a lane deviation 

tendency of the host vehicle, on the basis of a detecting 
condition of the lane defining line. 
[0008] The other objects and features of this 
invention will become understood from the following 

15 description with reference to the accompanying drawings. 
BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] Fig. 1 is a block diagram showing a structure 

of a lane deviation alarm system according to a first 

embodiment of the present invention. 
20 [0010] Fig. 2A is a top view showing a camera system 

equipped on a vehicle, and Fig. 2B is a side view showing 

the camera system equipped on the vehicle. 

[0011] Fig. 3 is a flowchart showing a processing 

executed by the camera system. 
25 [0012] Fig. 4 is a view for explaining a model 

lane-defining lines. 

[0013] Fig. 5 is a view explaining a method of setting 
an initial value of a line candidate point detection area. 
[0014] Fig. 6 is a view explaining the method of 
30 setting the initial value of the line candidate point 
detection area in case that actual lane defining lines 
have been already detected. 
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[0015] Fig. 7 is a view explaining the method of 
setting line candidate point detection areas on a 
picked-up image. 

[0016] Fig. 8 is a view explaining a detecting method 
of the line candidate point . 

[0017] Fig. 9 is a view explaining an offset quantity 
between a previous candidate point and a present 
candidate point on a lane line model. 

[0018] Fig. 10 is a flowchart showing a procedure of a 
traveling condition monitor processing executed by a 
controller of the lane deviation alarm system according 
to the first embodiment of the present invention. 
[0019] Fig. 11 is a flowchart showing a procedure of a 
line non-detection frequency calculation processing 
executed by the controller. 

[0020] Fig. 12 is a flowchart showing a procedure of 
an anticipated deviation time set processing executed by 
the controller. 

[0021] Fig. 13 is a view explaining a 

forward- observed-point lateral -displacement estimated 

value y s . 

[0022] Figs. 14A and 14B are views explaining a reason 
of taking account of a vehicle-body sideslip angle fi when 
a lane -deviation tendency on a curve is determined. 
[0023] Fig. 15 is a graph showing a relationship 
between a turn angular speed and a vehicle speed. 
[0024] Fig. 16 is a graph showing a relationship 
between a sideslip angle at a center of gravity of the 
vehicle and the vehicle speed. 

[0025] Fig. 17 is a flowchart showing a procedure of a 
lane deviation determination processing executed by the 
controller. 
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[0026] Figs. 18A through 18H are timing charts 
explaining the operations of the lane deviation alarm 
system of the first embodiment according to the present 
invention . 

5 [0027] Fig. 19 is a flowchart showing a procedure of a 
traveling condition monitor processing executed by the 
controller of the lane deviation alarm system according 
to a second embodiment of the present invention. 
[0028] Fig. 20 is a flowchart showing a procedure of a 
10 deviation determination threshold correcting processing 
executed by the controller of the lane deviation alarm 
system according to the second embodiment of the present 
invention . 

[0029] Fig. 21 is a flowchart showing a procedure of 
15 an anticipated deviation time set processing executed by 
the controller of the lane deviation alarm system 
according to the second embodiment of the present 
invention . 

[0030] Figs. 22A through 22H are timing charts 
20 explaining the operations of the lane deviation alarm 

system of the first embodiment according to the present 
invention . 

DETAILED DESCRIPTION OF THE INVENTION 

[0031] Referring to the drawings, there are discussed 
25 embodiments according to the present invention in detail. 
[0032] Referring to Figs. 1 to 18, there is shown a 
first embodiment of a lane deviation alarm system 
according to the present invention. As shown in Fig. 1, 
the lane deviation alarm system is installed in a host 
30 vehicle 10 and comprises a road recognition camera system 
1, a controller 2, a vehicle speed sensor 4, a steering 
angle sensor 5 and an alarm device 7 . 
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[0033] Camera system 1 is installed in a passenger 
compartment of host vehicle 10. More specifically, 
camera system 1 is installed at an upper and laterally 
center position near a front window as shown in Figs . 2A 
5 and 2B so that a yaw angle between an optical axis of a 
lens of camera system 1 and a longitudinal center axis of 
vehicle 10 is 0 and a pitch angle therebetween is a. 
Camera system 1 takes an image of a road view within a 
range from several meters to several tens meters ahead of 

10 vehicle 10. Further, camera system 1 detects a relative 
positional relationship between host vehicle 10 and the 
lane defining lines of a traveling lane. Camera system 1 
comprises a CCD (Charge Coupled Device) image sensor as 
an image taking section. 

15 [0034] More specifically, camera system 1 obtains data 
of the image taken by a CCD of camera system 1. Camera 
system 1 processes the image in order to detect lane 
defining lines of a traveling lane. Camera system 1 
transforms a shape of the lane defining lines into a 

20 mathematical model by using a plurality of parameters 

representative of a shape of the road shape and a vehicle 
behavior of vehicle 10. By updating the parameters so as 
to correspond the detection result of the lane defining 
lines with model lane lines, camera system 1 detects and 

25 recognizes the road parameters representative of the road 
shape and the vehicle behavior. Camera system 1 outputs 
the obtained road parameter to controller 2. Herein, the 
road parameters includes a lateral displacement y r at a 
center of gravity of vehicle 10 relative to the lane 

30 center line, yaw angle <pr of vehicle 10 relative to the 

lane center line, pitch angle tj of vehicle 10, a height h 
of camera system 1 from a road surface, a road curvature 
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(an inverse of a radius of curvature) p, and a lane width 
W. The detailed explanation of the processing executed 
by camera system 1 will be discussed later. 
[0035] Vehicle speed sensor 4 detects a vehicle speed 
5 of vehicle 10 by measuring a revolution speed of an 

output shaft of a transmission or a revolution speed of a 
wheel, and outputs a signal indicative of the detected 
vehicle speed to controller 2. Steering angle sensor 5 
is a sensor for detecting a steering condition 

10 manipulated by a driver. More specifically, steering 

angle sensor 5 amplifies a rotational displacement of a 
steering shaft (not shown) which is integrally rotated 
with a steering wheel, directly or by means of a gear 
mechanism. Thereafter, steering angle sensor 5 detects 

15 the amplified rotational angle as a steering angle 

detection signal by means of an angle detecting mechanism 
such as a rotary encoder or potentiometer. 
[0036] Controller 2 executes the various controls 
employed in the lane deviation alarm system according to 

20 the present invention. More specifically, controller 2 
estimates a lane deviation tendency at the moment when a 
predetermined time elapsed from the present time moment, 
on the basis of the vehicle speed detected by vehicle 
speed sensor 4, the present steering angle detected by 

25 steering angle sensor 5, and the road parameters supplied 
from camera system 1 . Herein the predetermined time into 
future is a time period necessary for moving vehicle 10 
from a present vehicle position on the lane to a 
predetermined position. Controller 2 monitors a 

30 traveling condition of vehicle 10 while estimating the 
lane deviation tendency of vehicle 10 relative to the 
lane at a moment when the predetermined time elapsed from 
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the present time. 

[0037] When controller 2 determines that there is a 
high possibility that vehicle 10 deviates from the 
traveling lane, from an estimation result of the lane 
5 deviation tendency, controller 2 outputs a drive signal 
to an alarm device 7 to generate warning sound or 
displaying warning information so as to give a warning to 
the driver. 

[0038] The detailed explanation as to the monitoring 
10 processing of the thus traveling condition will be 
discussed later. 

[0039] Alarm device 7 has a function of giving a 
stimulation to the senses of sight, hearing, touch or the 
like of a driver, such as a buzzer, audio system, 

15 steering actuator or meter display device. By outputting 
an alarm sound, vibrations to the steering wheel, or an 
alarm display, controller 2 informs the driver that there 
increases the possibility of a lane deviation of vehicle 
10 from the traveling lane. Thus, the lane deviation 

20 alarm system according to the present invention monitors 
a traveling condition of vehicle 10 while estimating the 
lane deviation tendency of vehicle 10 relative to the 
lane at a moment when the predetermined time elapsed from 
the present time. When there is a high possibility that 

25 vehicle 10 deviates from the traveling lane, the lane 

deviation alarm system warns the driver by applying the 
stimulations of giving a stimulation to the sense of 
sight, hearing, touch or the like of the driver, so as to 
effectively call the driver's attention. 

30 [0040] Subsequently, the processing executed by camera 
system 1 is discussed. A flowchart of Fig. 3 shows a 
procedure of a lane defining line detect processing 
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executed by camera system 1 . 

[0041] At step SI camera system 1 initializes the road 
parameters representative of a road shape and a vehicle 
behavior. Fig. 4 shows an image taken by camera system 1 
5 and an X-Y image -plane coordinate system. In this 
coordinate system, model lane defining lines are 
represented by the following expressions (1) and (2) 
using the road parameters. 

x={a-0.5e}(y-d)+b/(y-d)+c (1) 

io x={a+0.5e}(y-d)+b/(y-d)+c (2) 

where the expression (1) is an expression adapted to a 
right hand side as viewed from vehicle 10, the expression 
(2) is an expression adapted to a left hand side as 
viewed from vehicle 10, a, b, c, d and e are the road 

15 parameters. Assuming that a vertical dimension between 
camera system 1 and a road surface is constant, road 
parameter a denotes a lateral displacement y cr of vehicle 
10 between the lane defining lines, b denotes a road 
curvature p, c denotes yaw angle <pr of vehicle 10 (the 

20 optical axis of camera system 1) relative to the road, d 
denotes pitch angle tj of vehicle 10 (the optical axis of 
camera system 1) relative to the road, and e denotes 
dimension W between the lane defining lines. 
[0042] Under the initial condition, the shape of the 

25 road and the lane defining lines and the vehicle behavior 
are set at values corresponding to center values , 
respectively, since the shapes of the road and the lane 
defining lines and the vehicle behavior are not clear in 
this initial condition. More specifically, road 

30 parameter a corresponding to the lateral displacement y cr 
of vehicle 10 within the lane defining lines is set at a 
center between the lane defining lines, road parameter b 
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corresponding to road curvature p is set at straight 
(zero), road parameter c corresponding to yaw angle 
relative to the lane defining lines is set at zero, road 
parameter d corresponding to pitch angle 77 relative to 
5 the lane defining lines is set at a° indicative of a 
vehicle stopping condition, and road parameter e 
corresponding to lane width W between the lane defining 
lines is set at a lane width of a highway defined by the 
rule of a road structure. 

10 [0043] More specifically, road parameters a, b, c, d 
and e are defined as follows . In case that a desired 
point in an actual coordinate system fixed in the vehicle 
is projected on an image coordinate system (x, y) wherein 
X-axis is a lateral (right and left) direction of vehicle 

15 10, Y-axis is a vertical direction of vehicle 10, and 
Z-axis is a longitudinal (fore-and-aft) direction of 
vehicle 10, the corresponding image coordinate system (x, 
y) are expressed by the following expressions (3) 

x=-(f/Z)X, y=-(f/Z)Y ---(3) 

20 where f is a lens parameter and is a coefficient 

corresponding to a focal length of a lens. Assuming that 
road curvature p is not so large and a road surface is 
flat, the coordinate of the lane defining lines relative 
to a vehicle center line (camera center line) along Z 

25 direction (forward direction) is expressed by the 

following expressions (4), (5) relating to the lateral 
direction and (6) relating to the vertical direction. 
Herein, the above assumption is for simplifying a model, 
and by increasing the dimension of the model, these 

30 expressions are available even under a general condition. 

X=0 . 5pZ 2 - <prZ - Ycr- 0 . 5W ( 4 ) 
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X=0 . 5pZ 2 -&:Z-ycr+0 . 5W ( 5 ) 

Y=77Z-h (6) 

where the expression (4) is an expression corresponding 
to the right hand side operation as viewed from vehicle 
10, and the expression (5) is an expression corresponding 
to the left hand side operation as viewed from vehicle 10 
By eliminating X, Y and Z from the expressions (3) 
through (6), the following expressions (7) and (8) are 
obtained. 

x= ( Ycr+0 . 5W) (y+f tj) /h+f ^-0 . 5f 2 ptx/ (y+f rj) - - - ( 7 ) 

x= (Ycr-0 . 5W) (y+f rj) /h+f ^-0 . 5f 2 pYi/ (y+f 77) - - - ( 8 ) 

where the expression (7) is an expression corresponding 
to the right hand side operation as viewed from vehicle 
10, and the expression (8) is an expression corresponding 
to the left hand side operation as viewed from vehicle 10 
[0044] By normalizing each road parameter using the 
expressions (7) and (8) on the assumption the road width 
W, whose deviation is the smallest in those of the road 
parameters, is constant, lateral displacement y cr of 
vehicle 10, road curvature p. yaw angle <pr, and the height 
h of camera system 1 are expressed by the following 
expressions ( 9 ) . 

Ycr=W*a/e, p=2b*e(f 2 *h) , ^=c/f, h=We (9) 

[0045] Road parameters a, b, c, d and e are set in 
this manner. Accordingly, the road parameters are 
initialized at step SI, as discussed above. 
[0046] At step S2 camera system 1 initializes a side 
of small areas for detecting a candidate point of the 
lane defining line as shown in Fig. 5. As shown in Fig. 
5, in this embodiment ten search areas including five 
right search areas and five left search areas are 
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searched, and the size of each search area is set large. 
Under the initial condition, since it is supposed that 
there is a large difference between the model lane 
defining lines obtained by inputting the initial values 
5 into the respective road parameters a to e and the actual 
lane defining lines on the image plane, it is preferable 
that relatively large areas are set initially. 
[0047] When the lane defining lines have been detected 
already in the previous processing, it is assumed that 

10 the difference between the actual lane defining lines and 
the mode lane defining lines is small. Therefore, as is 
apparent from the comparison with Fig. 5, the size of 
each search area is set small as possible, as shown in 
Fig. 6. By setting the size of each search area small, a 

15 possibility of an erroneous detection of detecting other 
objects is decreased. Further, it becomes possible to 
improve the processing speed of this processing. 
[0048] At step S3 camera system 1 receives an image 
which was obtained by the image processing section of 

20 camera system 1 . 

[0049] At step S4 camera system 1 sets the search 
areas of the candidate lane defining lines on the road 
image produced by the image processing section through 
the processing at step SI. During this setting, the 

25 candidate lane-def ining-line search areas on the road 
image are set on the basis of the candidate 
lane-def ining-line search arrears obtained at step S2 and 
one of the road parameters initially set at step SI and 
the model lane-defining lines corrected by the road 

30 parameters as discussed at step S9 discussed later. 
[0050] More specifically, the candidate 
lane-def ining-line search areas are set on the road image 
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so that the model lane-defining- lines are located at 
centers of the respective search areas as shown in Fig. 7. 
As shown in Fig. 7, the number of the lane-def ining-line 
search areas is 10 constituted by 5 search areas for the 
5 right lane defining line and 5 search areas for the left 
lane defining line. It will be understood that the 
lane-def ining-line search areas may be set at positions 
offset from the model lane defining lines according to 
the change of the past model lane defining lines. , 
10 [0051] At step S5 camera system 1 detects the 
candidate point of the lane defining line in each 
lane-def ining-line search area. 

[0052] In this detecting operation, first a 
differential image is produced by filtering the input 

15 image with a Sobel filter. Then camera system 1 counts 

suitable pixels which are located on the line segment and 
whose densities are greater than a value capable of 
extracting the detection line, relative to each line 
segment generated by connecting a point on an upper base 

20 line and a point on a lower base line of each search area, 
as shown in Fig. 8. Further the points on the upper and 
lower base lines are varied, and as to a predetermined 
number of the line segments the counting of the suitable 
pixels are executed. The line segment, which includes 

25 the largest number of the suitable pixels in the whole 

line segments, is determined as a detection straight line. 
The start and end of the detection straight line are 
determined as the lane-def ining-line candidate points. 
When the number of the suitable pixels of the determined 

30 detection straight line is smaller than a predetermined 
rate to the number of pixels corresponding to the length 
of the search area, camera system 1 determines that there 
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is no candidate lane-def ining-line point in this search 
area . 

[0053] For example, under a condition that the number 
of pixels corresponding to the length of the search are 
5 is 15 and the predetermined rate is 1/2, if the number of 
the suitable pixels of the detection straight line 
segment are eight or more, camera system 1 determines 
that the start and the end of the selected line segment 
is treated as the candidate lane-def ining-line points. 
10 If the number of the suitable pixels of the detection 
straight line are seven or less, camera system 1 
determines that there is no candidate lane-def ining-line 
point . 

[0054] The above operation of determining the 

15 candidate lane-def ining-line points is executed by each 
candidate lane-def ining-line search area. For example, 
in case that the number of the lane-def ining-line search 
areas is set at 10 constituted by 5 search areas for the 
right lane defining line and 5 search areas for the left 

20 lane defining line, the above operation is executed by 
each of 10 lane-def ining-line search areas. 
[0055] In determining the candidate lane-def ining-line 
points, the predetermined rate may be set at a constant 
rate throughout all search areas or may be varied by each 

25 search area. Further the predetermined value of the 
density may be set at a constant value throughout all 
search areas or may be varied by each search area. 
[0056] At step S6 camera system 1 checks whether the 
number of the candidate lane-def ining-line points of the 

30 whole candidate lane-def ining-line search area is greater 
than or equal to a predetermined value agreeable to 
deciding as a lane defining line. When the number of the 
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candidate lane-def ining-line points is smaller than the 
predetermined value, camera system 1 determines that 
there is no lane defining line in the search areas, and 
the routine of this flowchart returns to step S2 to again 
5 initialize the size of the search area. When the number 
of the candidate lane -marker points is greater than or 
equal to the predetermined value, the routine proceeds to 
step S7. 

[0057] At step S7 camera system 1 calculates an offset 

10 quantity between the determined candidate 

lane-def ining-line point and a point on the model lane 
defining line obtained by the previous processing by each 
candidate lane-def ining-line point. 
[0058] At step S8 camera system 1 calculates 

15 fluctuation quantities Aa, Ab, Ac, Ad and Ae of the road 
parameters a through e. The calculation of the 
fluctuation quantities Aa through Ae may be executed on 
the basis of a least- square method, for example, 
disclosed in Japanese Published Patent Application No. 8- 

20 5388. 

[0059] At step S9 camera system 1 corrects road 
parameters a to e on the basis of fluctuation quantities 
Aa to Ae calculated at step S8 . When the model lane 
defining line expressed by the equation (1) is employed, 

25 the correction of the fluctuation quantities is executed 
using the following expressions (10). 

a=a+Aa, b=b+Ab, c=c+Ac, d=d+Ad, e=e+Ae (10) 

[0060] The corrected road parameters a through e are 
stored in a predetermined memory area of camera system 1 

30 as a road parameters of a new model lane-def ining-line . 
Further, the corrected road parameters a through e are 
converted into actual physical quantities using the 
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expressions (9) and stored the obtained physical 
quantities in the memory area of camera system 1 . 
Subsequent to the execution of step S9, the routine 
returns to step S3 to repeat the above mentioned routine. 
5 [0061] Camera system 1 executes the above-discussed 
processing and outputs road parameters a through e of the 
model lane defining lines to controller 2. Controller 2 
executes a traveling condition monitor processing for 
generating alarm according to the traveling condition of 

10 vehicle 10, on the basis of road parameters a through e. 
[0062] There is briefly explained the calculation for 
obtaining the above-discussed road parameters a through e, 
although the detailed explanation is made in Japanese 
Published Patent Application No. 8-5388. 

15 [0063] First it is assumed that a road structure on 
the road image smoothly varies with respect to a 
time-axis. Fig. 9 shows a change of a line defining line 
between a previous moment and a present moment. For 
example, camera system 1 takes (picks up) a road surface 

20 image at predetermined intervals such as an interval 
ranging from 50 to 100msec, and extracts a part of a 
lane defining line (white line) from the road image. 
Further controller 2 obtains x and y coordinates of the 
part of the lane defining line (white line) and estimates 

25 the road parameters in real time. The estimation of the 
road parameter is executed by a method of comparing a 
previous line position obtained from a road image of a 
previous frame and a present line position of a present 
frame. 

30 [0064] Assuming that fluctuation quantities of the 
previously obtained road parameters a through e are Aa 
through Ae, a small fluctuation of the j-th point x 1:J of 
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the i-th lane -defining -line on the road image (x, y) is 
expressed by the following expression (11) based on 
Taylor's theorem and by neglecting second-order and 
more-order terms. 

5 Ax i:J =A ' i: ,Aa+B ' 1:J Ab+C ' tjAc+D ' i-jAd+E ' ±j Ae (11) 

where A' ij =3x id /aa, B ' ij=3x i:3 /db , C ' n=dx±i/dc , D ' ij=3xij/ 3d, 
E ' i: j=dxij/de , and where a subscript i takes 0 or 1 , and a 
subscript j is an integer for distinguishing the detected 
lane-def ining-line candidate points. When i=0 denotes a 

10 right lane defining line and i=l denotes a left lane 
defining line, x coordinates of lane-def ining-line 
candidate points are represented by the expressions (1) 
and (2), and therefore the expressions (1) and (2) are 
commonly expressed by the following expressions (11) and 

15 (12). 

x 0d ={a-0.5e}(yoj-d)+b/(y 0 j-d)+c (12) 

x lj ={a+0.5e}(y lj -d)+b/(yi j -d)+c ---(13) 

where subscript i may not limited to two values (0 and 1), 

and may take an integer ranging from 0 to 3 when the 
20 system can detect a lane defining line of the adjacent 

lane, so that the setting can be changed according to the 

detected lane defining line. 

[0065] The estimation of fluctuation quantities Aa 
through Ae is executed using a method of least squares. 

25 First at the j-th point of the i-th lane defining line on 
the road image (x, y) , an error between the previous line 
position obtained from a road image of a previous frame 
and a present line position of a present frame is 
represented by the following expressions (14). 

30 When a line candidate point is detected, Kij=x ne wij-Xoidij 
When a line candidate point is not detected, K i:J =0 
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---(14) 

where a subscript new of x means that a value of Xij is a 
present value, and a subscript old of x means that a 
value of Xij is a previous value of the previous frame 
5 before the present frame. 

[0066] The following expression (15) is defined as an 
error performance function. 

Jtotal = Jmodel+ Jsmooth ( 15 ) 

where Jmodei and J sra ooth are represented by the following 
10 expressions (16) and (17). 

n n 

Jmodel= J P^ Ax 0j " K 0j } 2 + J P j{AXl j " K x j} 2 ---(16) 
j«l 3=1 

Jsmooth=SAaAa 2 +SAbAb 2 +S A cAc 2 +SAdAd 2 +S A eAe 2 ( 17 ) 

where an integer n is set as an upper limit of the number 
of lane -defining- line candidate points for one lane 

15 defining line. 

[0067] The expression (16) is an error performance 
function defined by a difference between a previously 
detected result Xij_i and a newly detected result x ±j , and 
Pij in the expression (16) represents a degree of 

20 certainty of the lane-def ining-line candidate point. 
The expression (17) is an error performance function 
which represents an assumption that the parameters 
smoothly vary along the time-axis, and S denotes a weight 
coefficient . 

25 [0068] All elements of the error performance function 
Jtotai represented by the expression (15) have the minimum 
values, respectively, and are represented by monotonously 
increasing function as the error increases. Therefore, 
by obtaining extremes of the function Jtotai/ fluctuation 

30 quantities Aa through Ae are obtained. That is, the 
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fluctuation quantities Aa through Ae are obtained by 
solving the following equation (18). 



d J total 3 J total dJ total d J total dJ total 



3Aa dAa dAa 3Aa dAa 



T 



= [o 0 o o of 

---(18) 

[0069] All of partial differentials of the error 
performance function in the equation (18) is expressed by 
the following expressions (19a) through (19e). 

d J total = dJ mod el dJ smooth 
dAa dAa aAa 



: 2 2 p^Axoj - K 0j }^-3_ +2 ^ Pj {Ax 1;| - K X j}^^ + 2S Aa Aa 



= 2{ ^ P jA'oj {Ax oj - K 0j } + f Pj A' 1;j {Ax 1;j - K 1;j } + 2S Aa Aa} 
j=l 3=1 

---(19a) 

^^ = 2C2 Pj B' 0j {Ax 0j -Ko^ + ^PjB'^CAXij -K 1;j >+2S Ab Ab} 
aAb j=i j=i 

---(19b) 

5J total 



3Ac j=l j-l 



8J 



total 



= 2C2p j C* 0j {Ax 0j - Ko^ + JpjC'i^AXij - K li }+ 2S Ac Ac} 

---(19c) 

= 2Cj P-jD' 0;j {Ax 0 j - K oj > + JpjD'i^AXij - K 1;j > + 2S Ad Ad} 

---(19d) 



dJ 



total 



n n 
= 2C2PjE , 0 j{Ax 0 j -K 0j } + 2P3E' lj {Ax lj -K 1:j }+ 2S Ae Ae> 



dAe j= i >1 

---(19e) 

[0070] By simultaneously solving the expressions (19a) 
through (19e) and by expressing the determinant of the 
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equation (18) in the form of a formula, the following 
expression (20) is obtained. 

{S w + S s )[Aa Ab Ac Ad A&f - S k = 0 (20) 

where S w , S K and S s are column vectors and are 
respectively expressed by the following expressions (21), 
(22) and (23) . 



S w = 5 { Pj[ A 'oj B 'oj c 0j D 'oj E'ojMA' 0J B' oj C' oj D' oj E'o-J 
+ 2«Pj[ A '« B 'ld C U D 'u E'liK^'lj B' 1;j Cfy D' 1;j 



3=1 



3=1 



---(21) 



Sk = i<P 3 [ A, 0j B'oj C' oj D' oj E'ojfK'oj} 



j=l 



+ it P j[ A 'l3 B 'lj C 'l3 D 'ld E'l^K'ljJ 
j=l 



s s = 



s Aa 


0 


0 


0 


0 


0 


s Ab 


0 


0 


0 


0 


0 


s Ac 


0 


0 


0 


0 


0 


s Ad 


0 


0 


0 


0 


0 


S Ae 



---(22) 



---(23) 



15 [0071] The fluctuation quantities Aa through Ae, which 
satisfy the expression (20), is obtained using the 
following expression (24) only when the sum of the 
expressions (21) and (22) has an inverse matrix. 

[Aa Ab Ac Ad Aef = (S w + SgT 1 ^ ---(24) 
20 [0072] Thus, the road parameters a through e are 

updated by correcting road parameters e through e using 
fluctuation quantities Aa through Ae obtained by the 
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above-discussed manner. Although the embodiment has been 
explained such that the road parameters a through e are 
corrected using the method of least squares, a parameter 
estimating means adaptable to a non-linear system, such 
5 as an extended Kalman filter. 

[0073] Subsequently, there is explained a traveling 
condition monitor processing executed by controller 2. 
Fig. 10 shows a procedure of the traveling monitor 
processing. 

10 [0074] At step S21 controller 2 reads road parameters 
y cy , p and <f>r of the model lane defining line, which have 
been stored as new road parameters of the model lane 
defining line. Further controller 2 read a right line 
non-detection flag flag_r and a left line non-detection 

15 flag flag_l. Right line non-detection flag flag_r is a 

flag indicative that camera system 1 detects a right lane 
defining line. When the right lane defining line is 
detected, right line non-detection flag flag_r is set at 
1 (flag_r=l). When the right lane defining line is not 

20 detected, right line non-detection flag flag_r is set at 
0 (flag_r=0). Similarly, when the left lane defining 
line is detected, left line undetected flag flag_l is set 
at 1 (flag_l=l). When the left lane defining line is not 
detected, left line non-detection flag flag_l is set at 0 

25 (flag_l=0) . 

[0075] At step S33 controller 2 reads vehicle 
traveling condition data. Herein, the vehicle traveling 
condition data comprises a vehicle speed V detected by 
vehicle speed sensor 4, a present steering angle 8 of the 
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steering wheel, which is detected by steering angle 
sensor 5. 

[0076] At step S30 controller 2 executes a calculation 
processing of the lane-def ining-line non-detection 
5 frequencies. Fig. 11 shows a procedure of the 

lane-def ining-line non-detection frequency calculation 
processing. 

[0077] At step S31 in Fig. 11, controller 2 sets a 
frequency calculation time T f (sec.) employed in the 

10 lane-def ining-line non-detection frequency calculation. 
[0078] At step S32 controller 2 calculates a right 
line non-detection frequency Frh. More specifically, 
controller 2 reads right line non-detection flag flag_r 
obtained during a period from a present moment to the 

15 past frequency calculation time T f . 

[0079] The right line non-detection frequency Frh 
during the period from a present moment to the past 
frequency calculation time T f is calculated using right 
line non-detection flag flag_r, by means of a moving 

20 average processing during the predetermined time period 
(the period from a present moment to the past frequency 
calculation time T f ) . Right line non-detection frequency 
Frh is a frequency of not capable of detecting the right 
lane defining line during the period from the present 

25 moment to the past frequency calculation time T f . Herein, 
when a calculation sampling time is AT, right line 
non-detection frequency Frh(t) is obtained by the 
following expression (25) representative of the moving 
average processing . 

Am Tf / AT 

30 Frh(t)= — Y{flag_r(t-kAT)} ---(25) 

Tf 

1X k=0 
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[0080] At step S33 controller 2 calculates a left line 
non-detection frequency Flh. More specifically, 
controller 2 reads left line noh-detection flag flag_l 
obtained during a period from a present moment to the 
5 past frequency calculation time T f . 

[0081] The left line non-detection frequency Flh 
during the period from a present moment to the past 
frequency calculation time T f is calculated using left 
line non-detection flag flag_l, by means of the moving 

10 average processing during the predetermined time period 
(the period from a present moment to the past frequency 
calculation time T f ) . Left line non-detection frequency 
Flh is a frequency of not capable of detecting the left 
lane defining line during the period from the present 

15 moment to the past frequency calculation time T f . Herein, 
when a calculation sampling time is AT, left line 
non-detection frequency Flh(t) is obtained by the 
following expression (26) representative of the moving 
average processing. 

Am Tf /AT 

20 Flh(t) = V{flag_Kt-kAT)> ---(26) 

Tf " 

11 k=0 

[0082] The processing from steps S31 through S33 is 
executed at step S30, and the main routine in Fig, 10 
then proceeds to step S40. 

[0083] At step S40 controller 2 executes a set 
25 processing of a anticipated deviation time Tttlc of 

traveling vehicle 10, Anticipated deviation time Tttlc 
is a time period from a present moment to an anticipated 
deviation moment on the basis of a present vehicle 
traveling condition (lateral displacement and yaw angle 
30 of vehicle 10 relative to a traveling lane). Herein, a 
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lane deviation is defined as a condition that a front 
wheel of vehicle 10 crosses with a lane defining line of 
the traveling lane so that vehicle 10 deviates from a 
traveling lane . 
5 [0084] Anticipated deviation time Tttlc is set as a 
parameter for defining an alarm timing. By using 
anticipated deviation time Tttlc as an alarm timing, 
alarm is generated when the lane deviation is generated 
after anticipated deviation time Tttlc elapsed. 
io Therefore, it becomes possible to timely generate the 
alarm as to the lane deviation. 

[0085] For example, when it is possible to complete a 
proper lane -deviation avoidance operation within 1.0 
second after a driver is aware of the alarm, anticipated 

15 deviation time Tttlc is set at 1.0 second. With this 
arrangement, it becomes possible for the driver to 
properly complete the lane -deviation avoidance by 
executing the lane-deviation avoidance operation after 
being aware of the alarm. There is explained a setting 

20 of anticipated deviation time Tttlc with reference to Fig. 
12. 

[0086] At step S41 controller 2 determines whether or 
not right line non-detection frequency Frh(t) obtained at 
step S32 is greater than left line non-detection 

25 frequency Flh(t) obtained at step S33. When the 

determination at step S41 is affirmative (Frh( t ) >Flh(t) ) , 
the program proceeds to step S42. When the determination 
at step S41 is negative (Frh(t)^ Flh(t)), the program 
proceeds to step S43. 

30 [0087] At step S42 controller 2 calculates anticipated 

deviation time Tttlc using the following expressions (27). 
When Frh(t)<Flo, Tttlc=Tttlcl . 
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When Flo^Frh(t)<Fhi, 

Tttlc=Tttlcl*( (Fhi-Frh(t) )/(Fhi-Flo) ) . 
When Fhi^Frh(t), Tttlc=0. 

-—(27) 

5 where Tttlcl is a fixed value which is greater than 0, 
Flo is a minimum frequency, and Fhi is a maximum 
frequency. As is apparent from the expressions (27), 
when right line non-detection frequency Frh(t) is smaller 
than minimum frequency Flo, anticipated deviation time 

10 Tttlc is set a fixed value Tttlcl. When right line 

non-detection frequency Frh(t) is greater than or equal 
to minimum frequency Flo and is smaller than maximum 
frequency Fhi, anticipated deviation time Tttlc is set 
according to right line non-detection frequency Frh(t). 

15 When right line non-detection frequency Frh(t) is greater 
than maximum frequency Flo, anticipated deviation time 
Tttlc is set at 0. 

[0088] At step S43 controller 2 calculates anticipated 
deviation time Tttlc using the following expressions (28). 
20 When Flh(t)<Flo, Tttlc=Tttlcl . 

When Flo^Flh(t)<Fhi, 

Tttlc=Tttlcl»( (Fhi-Flh(t) )/(Fhi-Flo) ) . 
When Fhi^Flh(t), Tttlc=0 . 

---(28) 

25 where Tttlcl is a fixed value which is greater than 0, 
Flo is a minimum frequency, and Fhi is a maximum 
frequency, as discussed above. 

[0089] As is apparent from the expressions (28), when 
left line non-detection frequency Flh(t) is smaller than 
30 minimum frequency Flo, anticipated deviation time Tttlc 
is set a fixed value Tttlcl. When left line 
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non- detection frequency Flh(t) is greater than or equal 
to minimum frequency Flo and is smaller than maximum 
frequency Fhi, anticipated deviation time Tttlc is set 
according to left line non-detection frequency Flh(t). 
5 When right line non-detection frequency Frh(t) is greater 
than maximum frequency Flo, anticipated deviation time 
Tttlc is set at 0. 

[0090] As discussed above, controller 2 determines the 
presence or absence of lane-def ining-lines , on the basis 

10 of the lane-def ining-line candidate points defining a 
boundary of the picked-up image. And the detection 
result of the presence or absence of the line defining 
lines are right line non-detection frequency Frh(t) and 
left line non-detection frequency Flh(t). At step S40 

15 controller 2 sets anticipated deviation time Tttlc on the 
basis of right line non-detection frequency Frh(t) and 
left line non-detection frequency Flh(t). Therefore, 
anticipated deviation time Tttlc is set on the basis of 
the lane-def ining-line candidate points in the picked-up 

20 image. 

[0091] The routine in Fig. 10 proceeds to step S23 
after anticipated deviation time Tttlc is set on the 
basis of right and left line non-detection frequencies 
Frh(t) and Flh(t) through the execution of the 

25 anticipated deviation time processing at step S40. 

Herein, although anticipated deviation time Tttlc is 
represented by a first -order function of right line 
non-detection frequency Frh(t) or left line ' non-detection 
frequency Flh(t) using the expressions (27) or (28), the 

30 invention is not limited to this arrangement. 

Anticipated deviation time Tttlc may not be represented 
by the first-order function of right line non-detection 
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5 



frequency Frh(t) or left line non-detection frequency 
Flh(t), and may be arranged to monotonously decrease as 
right line non-detection frequency Frh(t) or left line 
non-detection frequency Flh(t) increases. 
[0092] At step S23 controller 2 calculates 
forward- observed-point distance L s from the following 
expression (29) using anticipated deviation time Tttlc 



set at step S40. 



L s =VxTttlc 



-"(29) 



10 [0093] At step S24 controller 2 calculates 

forward- observed-point lateral displacement estimated 
value y s at a position of forward-observed-point distance 
Ls from the following expression (30). 



15 where forward- observed-point lateral displacement 

estimated value y s means a lateral displacement of vehicle 
10 from a center of traveling lane at a position of 
f orward-observed-point distance L s . Since 

forward- observed-point distance L s obtained at step S23 is 
20 a product of vehicle speed and anticipated deviation time 
Tttlc, forward-observed-point lateral-displacement 
estimated value y s represents a lateral distance 
(anticipated distance) which vehicle 10 travels during a 
period from a present moment to a moment when anticipated 
25 deviation time Tttlc elapsed. For example, when the 

traveling road is generally straight, the magnitude of 
f orward-observed-point lateral -displacement estimated 
value y s directly represents a lane deviation tendency of 
vehicle 10. However, when the traveling road is a curve, 
30 this concept cannot be adapted directly. Accordingly, 
when the traveling road is a curve, controller 2 
determines the lane deviation tendency from the following 



Y s =y C r+L s 0 r =y C r+ ( VxTttlC ) <pr 



---(30) 
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concept. That is, controller 2 determines the lane 
deviation tendency on a cured road by correcting a 
vehicle body sideslip angle /? (offset between the 
direction of the vehicle body and the traveling direction 
5 of vehicle 10). 

[0094] Figs. 14A and 14B show views for explaining a 
reason for taking account of vehicle body sideslip angle 
ft. Both of Figs. 14A and 14B show a situation that 
vehicle travels a curved road while finely traces a 

10 center of a traveling lane. Vehicle 10 shown in Fig. 14B 
travels at a vehicle speed higher than that of vehicle 10 
shown in Fig. 14A. Although the vehicle speed of vehicle 
shown in Fig. 14A is different from that of vehicle shown 
in Fig. 14B, both vehicles are put in a constant turn 

15 condition so as to finely trace a center of the traveling 
lane. This means that both vehicles are put in an ideal 
traveling state in the meaning of avoiding a 
lane -deviation. Therefore, in view of the lane deviation 
tendency, both traveling conditions of vehicles shown in 

20 Figs. 14A and 14B should be evaluated to be equivalent. 
For example, a vehicle having a general under- steer 
characteristic generates and increases vehicle body 
sideslip angle at a turn inner side as the vehicle speed 
increases . 

25 [0095] That is, as shown in Fig. 15, when a vehicle 

having a neutral steer characteristic turns at a constant 
steering angle, a turn angular speed linearly increases 
as the vehicle speed increases. When a vehicle having an 
under-steer characteristic (US characteristic in Fig. 15) 

30 turns at a constant steering angle, the turn angular 

speed increases to a predetermined speed as the vehicle 
speed increases. That is, the turn angular speed does 
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not become greater than the predetermined speed. However, 
an absolute value of sideslip angle fi at a center of 
gravity of vehicle 10 increases in proportion to a square 
of the vehicle speed as shown in Fig. 16. Thus, sideslip 
5 angle fi at a center of gravity of vehicle 10 varies 

according to the vehicle speed regardless of the steer 
characteristic of vehicle, and the reason thereof is that 
the vehicle has to obtain a lateral force balanced with a 
centrifugal force according to the vehicle speed. 

10 [0096] Sideslip angle fi at a center of gravity of 

vehicle 10 is an angle between a fore-and-aft direction 
of vehicle and a traveling direction of a center of 
gravity of vehicle. More specifically, sideslip angle fi 
corresponds to an angle of a tangential direction of a 

15 turn circle and represents an attitude of vehicle 10 with 
respect to a turn circle in a steady circular turn. A 
fact that this sideslip angle takes a negative value and 
increases its absolute value as vehicle speed increases 
represents that the vehicle increases a tendency of 

20 executing a circle turn while directing a vehicle head 
toward an inner side of the turn circle as the vehicle 
speed increases . A detailed explanation of the above 
discussed vehicle behaviors is disclosed in "VEHICLE 
DYNAMICS AND CONTROL (third edition)", Masato Abe, 

25 published on May 31, 1996, pages 60-70. 

[0097] When there is a difference between the vehicle 
speeds of the vehicles shown in Fig. 14A and 14B such 
that the vehicle speed of the vehicle shown in Fig. 14A 
is 50-60 km/h and the vehicle speed of the vehicle shown 

30 in Fig. 14B is 100 km/h, the meaning of 

forward- observed- point lateral - displacement estimated 
value y s becomes different therebetween. Therefore, at 
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step S25 controller 2 estimates vehicle body sideslip 
angle fi from a vehicle model identification value, 
vehicle speed V, actual steering angle 6 and road 
curvature p. using the following expression (31). 

\y] ---(31) 

C f + C r C f l f C f + l r C r lfC f 

where a xl = f r , a 12 = — f- , a 21 = , a 22 — , 

mV mV I I 

2 2 

bn = lrCr ~ lfCf -1, b 21 = lr Cr ~ lf ° f . and y=V p . Further, I 
mV 2 IV 

is a vehicle-body yaw inertia moment, m is a vehicle 

weight, l f is a distance between a center of gravity and a 

10 front wheel, l r is a distance between the center of 

gravity and a rear wheel, C f is a front -wheel cornering 
power for 2 wheels, C r is a rear-wheel cornering power for 
2 wheels, V is the vehicle speed, y is a yaw rate, 8 is a 
front-wheel actual steering angle, y8 is the sideslip 

15 angle and p is the road curvature. 

[0098] At step S26 controller 2 corrects 
forward- observed-point lateral -displacement estimated 
value y s using vehicle body sideslip angle fi. More 
specifically, controller 2 sets a product of 

20 forward- observed-point distance L s and vehicle body 
sideslip angle (L s xyS) as a correction value of 
forward- observed-point lateral -displacement estimated 
value, and sets forward-observed-point 
lateral-displacement estimated value (lane deviation 

25 evaluation point) y r s of the correction value from the 
following expression (32) using the correction value 
(L s x£) . 

y' s =y s +W? ---(32) 
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[099] The expression (32) expresses that corrected 
forward- observed-point lateral-displacement estimated 
value y' s is varied from pre-correction 
forward-observed-point lateral -displacement estimated 
5 value y s by a correction quantity (L s x/?) . 

[0100] At step S50 controller 2 determines whether or 
not host vehicle 10 is in a condition of the lane 
deviation tendency, by comparing the corrected 
forward- observed-point lateral -displacement estimated 
10 value y' s with predetermined thresholds Yth_r and Yth_l. 
[0101] Fig. 17 shows a procedure of a lane deviation 
determination processing. 

[0102] At step S51 controller 2 determines whether or 
not host vehicle 10 is in a lane deviation tendency 

15 toward a right adjacent lane, by comparing the corrected 
forward- observed-point lateral -displacement estimated 
value y' s with predetermined threshold Yth_r. Right 
deviation determination threshold Yth_r is, for example, 
set at a predetermined fixed value Ythl. More 

20 specifically, controller 2 determines whether corrected 
forward- observed-point lateral- displacement estimated 
value y' s is smaller than right deviation determination 
threshold Yth_r. Herein, right deviation determination 
threshold Yth_r is a value which has been previously 

25 obtained as a result of experiments. For example, right 
deviation determination threshold Yth_r is a fixed value. 
When the determination at step S51 is affirmative, that 
is, when corrected forward-observed-point 
lateral-displacement estimated value y' s is smaller than 

30 right deviation determination threshold Yth_r (y' s < 

Yth_r), controller 2 determines that the vehicle is in 
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the lane deviation tendency toward the right adjacent 
lane, and the program proceeds to step S52. When the 
determination at step S51 is negative, that is, when 
corrected forward-observed-point lateral- displacement 
5 estimated value y f s is greater than or equal to right 
deviation determination threshold Yth_r (y' s ^ Ythr) , 
controller 2 determines that the vehicle is not in the 
lane deviation tendency toward the right adjacent lane, 
and the program proceeds to step S53. 

10 [0103] At step S52 controller 2 generates a right 

deviation alarm command, and the program of Fig. 17 is 
then terminated. At step S53 controller 2 stops the 
right deviation alarm command, and the program then 
proceeds to step S54. 

15 [0104] At step S54 controller 2 determines whether or 
not host vehicle 10 is in a lane deviation tendency 
toward a left adjacent lane, by comparing the corrected 
forward-observed-point lateral- displacement estimated 
value y's with predetermined threshold Ythl. Left 

20 deviation determination threshold Yth_l is, for example, 
set at a predetermined fixed value Ythl. More 
specifically, controller 2 determines whether corrected 
forward- observed-point lateral -displacement estimated 
value y' s is smaller than left deviation determination 

25 threshold Yth_l. Herein, left deviation determination 
threshold Yth_l is a value which has been previously 
obtained as a result of experiments. For example, left 
deviation determination threshold Yth_l is a fixed value. 
When the determination at step S54 is affirmative, that 

30 is, when corrected forward-observed-point 

lateral- displacement estimated value y' s is smaller than 
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left deviation determination threshold Yth_l (y' s < Yth_l), 
controller 2 determines that the vehicle is in the lane 
deviation tendency toward the left adjacent lane, and the 
program proceeds to step S55. When the determination at 
5 step S54 is negative, that is, when corrected 

forward-observed- point lateral-displacement estimated 
value y' s is greater than or equal to left deviation 
determination threshold Yth_l (y' s ^ Yth_l) , controller 2 
determines that vehicle 10 is not in the lane deviation 
10 tendency toward the left adjacent lane, and the program 
proceeds to step S56. 

[0105] At step S55 controller 2 generates a left 
deviation alarm command, and the program of Fig. 17 is 
then terminated. At step S55 controller 2 stops the left 
is deviation alarm command, and the program of Fig. 17 is 
then terminated . 

[0106] Subsequently, there is discussed a function and 
operation of the traveling condition monitor processing 
with reference to timing charts shown in Figs. 18A 
20 through 18H. 

[0107] Fig. 18A shows a change of left line 

non-detection flag flag_l indicative of a left 
lane-def ining-line detection condition picked up by 
camera system 1. Fig. 18B shows a change of right line 
25 non-detection flag flag_r indicative of a right 

lane-defining line detection condition picked up by 
camera system 1 . 

[0108] In this embodiment, it is assumed that the 
detection and the non-detection of the right 
30 lane-def ining-line is repeated as shown in Fig. 18B. 
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Under this condition, right line non-detection flag 
flagr fluctuates between 0 and 1 within a short time. 
[0109] In the lane-def ining-line non-detection 
frequency calculation processing executed at step S30, 
5 right lane-def ining-line non-detection frequency Frh, 
which is calculated by the moving average processing of 
right lane-def ining-line non-detection flag flag_r during 
the predetermined time period, is varied as shown in Fig. 
18C. In this embodiment, right line non-detection 

10 frequency Frh increases from 0 when right line 

non-detection flag flag_r starts to fluctuate between 0 
and 1 . When a predetermined time period elapsed from the 
start of a fluctuation of right line non-detection flag 
flag_r fluctuated, between 0 and 1, right line 

15 non-detection frequency Frh reaches maximum frequency Fhi, 
and thereafter the fluctuation of right line 
non-detection flag flag_r between 0 and 1 is terminated, 
and right line non-detection frequency Frh decreases. 
[0110] In the anticipated deviation time setting 

20 processing executed at step S40, controller 2 sets 

anticipated deviation time Tttlc on the basis of right or 
left non-detection frequency Frh or Flh. In this 
embodiment, since right line non-detection frequency Frh 
is higher than left line non- detection frequency Flh, 

25 controller 2 sets anticipated deviation time Tttlc on the 
basis of right line non-detection frequency Frh. Since 
anticipated deviation time Tttlc is calculated so as to 
be in proportion to right line non-detection frequency 
Frh as is apparent from the expression (27), anticipated 

30 deviation time Tttlc varies as shown in Fig. 18D. More 
specifically, anticipated deviation time Tttlc starts to 
decrease from fixed value Tttlcl which is an initial 
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value as right line non-detection frequency Frh increases. 
When right line non-detection frequency Frh reaches the 
maximum frequency Fhi, Tttlcl takes 0. Thereafter, 
Tttlcl increases as right line non-detection frequency 
5 Frh decreases . 

[0111] In the forward- observed-point distance 
calculation processing executed at step S23, controller 2 
calculates forward-observed-point distance L s from the 
expression (29). In the forward-observed-point 

10 lateral-displacement calculation processing executed at 
step S24, controller 2 calculates forward- observed-point 
lateral -displacement estimated value y s at the position of 
forward-observed-point distance Ls using the expression 
(16). At step S26, controller 2 obtains the corrected 

is forward- observed-point lateral -displacement estimated 
value y' s by correcting forward-observed-point 
lateral- displacement estimated value y s using 
forward-observed-point distance L s and vehicle body 
sideslip angle from the expression (32). 

20 [0112] At step S50 controller 2 determines whether or 
not host vehicle 10 is in the lane deviation tendency by 
comparing the corrected forward- observed-point 
lateral -displacement estimated value y' s with thresholds 
yth_r and Yth_l. According to the determination result, 

25 controller 2 outputs one of right and left deviation 
alarm command. 

[0113] Subsequently, advantages gained by this 
processing will be discussed. Herein, the vehicle 
dynamics during a traveling state is considered. The 
30 vehicle in the traveling state is always put in a 
pitching and bouncing state. Pitching is normally 
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generated, for example, when the vehicle is accelerated 
or decelerated. 

[0114] Under this situation, vertical disturbances are 
inputted independently to front and rear wheels. 
5 Accordingly, a simple bouncing quantity is relatively 
stabled (suppressed). However, pitch angle rj is 
represented as an image showing a difference of an 
intervals of the lane defining line projected on a screen 
(on CCD), it is correctly recognized as far as both right 

10 and left lane defining lines are detected. In other 

words, when neight of right and left lane defining lines 
is detected, it is not possible to correctly recognize 
pitch angle rj. As a result, forward observed point 
lateral displacement y s is also largely fluctuated. This 

15 frequently invites erroneous alarm operations . The 

reason of generating erroneous alarm operation is owing 
to the following relationship. 

[0115] In the interest of simplicity, it is assumed 

that the traveling road is generally straight having a 
20 sufficiently small curvature. Under this condition, the 

expressions (7) and (8) are represented by the following 

expressions (33) and (34). 

x= (y C r+0 . 5W) (y+f V) /h+f (pr - - - ( 33 ) 

x= ( Ycr- 0 . 5W) (y+f rj) /h+f - - - ( 34 ) 

25 where the expression (33) is an expression for the right 

side direction view as viewed from vehicle, and the 

expression (34) is an expression for the left side 

direction view as viewed from vehicle. 

[0116] Further, gradients k of right and left lane 
30 defining lines are represented by the following 
expressions (35) and (36). 

k=(x(l)-x(2) )/(y(l)-y(2) ) = (y cr +0.5W)/h ---(35) 
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k=(x(l)-x(2))/(y(l)-y(2)) = (y cr -0.5W)/h ---(36) 
where the expression (35) is an expression for the right 
side direction view as viewed from vehicle, and the 
expression (36) is an expression for the left side 
5 direction view as viewed from vehicle. 

[0117] The expressions represent that the fluctuation 
of lane width W and camera height h affect the estimation 
accuracy of lateral displacement y cr of vehicle 10 and 
that pitch fluctuation does not affect the lateral 

10 displacement. Further, these expressions represents that 
it is possible to calculate the lateral displacement y cr 
only from one of the lane defining lines when lane width 
W and camera height h are accurately recognized. 
[0118] The following expression (37) is obtained from 

15 the expressions (33) through (36). 
x=k(y+f 7?)+f <pr, 

k77+^ , = ( x+ky ) /f - - - ( 37 ) 

[0119] This expression (37) represents that it is 
possible to accurately calculate pitch angle t] and yaw 

20 angle ^ as long as both lane defining lines are detected 
and the gradients of the lane defining lines projected on 
screen are not equal. That is, when a gradient of the 
right lane defining line projected on the CCD screen is k r 
and when a gradient of the left lane defining line 

25 projected on the CCD screen is k x , pitch angle rj and yaw 
angle <pr are represented by the following expression (38). 



71 1 1 




X r -yk r " 


<p r \ f[k 




Xi -yki 



---(38) 



where when one of the lane defining lines is not detected, 
combinations of pitch angle rj and yaw angle <pr which 
30 satisfy the expression (38), are infinite. Therefore, it 
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is impossible to obtain both of pitch angle rj and yaw 
angle <pr without knowing one of pitch angle r\ and yaw 
angle <pr. 

[0120] From the above-discussed relationship, when one 
5 of the lane-def ining-lines is not detected, lane width W, 
whose fluctuation is relatively small during the vehicle 
traveling condition, is fixed at an average of lane width 
W detected until one of the lane-def ining-lines becomes 
not detected. When the road parameters are estimated on 

10 the basis of road width W, the lateral displacement of 
the vehicle has a relatively small fluctuation. On the 
other hand, when one of the lane-def ining-lines is not 
detected, pitch angle rj may be set at a fixed value. For 
example, pitch angle 77 may be fixed or estimated at an 

15 average of pitch angle tj detected until one of the 

lane-def ining-lines becomes not detected. Although it 
becomes possible to estimate the road parameters 
therefrom, when actual pitch angle 77 largely fluctuates, 
there causes an error between the actual pitch angle rj 

20 and the estimated pitch angle rj. This error directly 

generates an error of yaw angle <pr. That is, when a yaw 
angle estimated value is (f T . and a pitch angle error is 
Af7, yaw angle estimated value <p r is represented by the 
following expression (39) based on the expression (37). 

25 4> T = (x+ky ) /f -k( ?7+A?7) =<p\-KArj - - - ( 39 ) 

[0121] When one of the lane-def ining-lines is not 
detected, it is difficult to accurately estimate yaw 
angle #r. However, by employing the concept of the 
present invention, even when yaw angle <pr is estimated and 

30 when pitch angle rj is largely fluctuated, it becomes 



P03NM- 125/02-01134 



-39- 

possible to suppress the influence of 

forward-observed-point lateral -displacement y s on the 
estimated yaw angle fa. 

[0122] Figs. 18F and 18G represent changes of lateral 
5 displacement estimated value y cr and yaw angle <f>r in case 
that one of the lane-def ining-lines is not detected. 
When a pitching of the vehicle is generated under a 
condition that one of the lane-def ining-lines is not 
detected, yaw angle (yaw angle estimated value) <pr becomes 

10 fluctuated due to the pitching, as shown in Fig. 18G. 
Therefore, the fluctuation of forward-observed-point 
lateral -displacement y s becomes large as shown in Fig. 18H. 
As a result, forward-observed-point lateral -displacement 
y s also largely fluctuates, and the frequency of the 

15 erroneous alarms increases. For example, as shown in Fig 
18H, f orward-observed-point lateral-displacement y s (or 
corrected forward-observed-point lateral-displacement y' s ) 
unnecessarily becomes greater than right line deviation 
determination threshold Yth_r (Ythl), and erroneous 

20 alarms are generated. The driver feels such an erroneous 
alarm very noisy. 

[0123] In contrast to this, by employing the present 
invention in the control* as shown in step S40, when one 
of the lane-def ining-lines is not detected, that is, when 

25 the line non-detection frequency becomes greater than a 

predetermined value, anticipated deviation time Tttlc for 
calculating forward-observed-point lateral-displacement y s 
at steps S23 and S24, is gradually decreased. That is, 
as expressed by the expression (30), anticipated 

30 deviation time Tttlc for calculating 

f orward-observed-point lateral -displacement y s as a 
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product of anticipated deviation time Tttlc and yaw angle 
<pr is gradually decreased to a small value. 
[0124] With this arrangement according to the present 
invention, it becomes possible to decrease a rate of the 
5 yaw angle component, which largely fluctuates when one of 
the lane-defining- lines is not detected, in 
forward- observed-point lateral-displacement y s employed 
for determining the lane deviation. With this 
arrangement, even when yaw angle <pr is largely fluctuated 
10 by pitching and the like under the condition that one of 
the lane-def ining-lines is not detected, it becomes 
possible to suppress the fluctuation of 

forward-observed-point lateral -displacement y s , as shown 
in Fig. 18H. That is, this decreases the frequency of 
15 erroneous alarms, and suppresses the driver from having a 
noisy feeling. 

[0125] As shown at step S40 in Fig. 12, anticipated 
deviation time Tttlc is set according to the 
lane-def ining- line non-detection frequency. More 

20 specifically, anticipated deviation Tttlc is decreased as 
the lane-def ining-line non-detection frequency increases. 
That is, the error of estimated yaw angle <pr indicative of 
a vehicle condition becomes larger as the 
lane-def ining-line non-detection frequency increases. 

25 Accordingly, the frequency of the erroneous alarms also 
increases under this condition. Upon taking account of 
the tendency, by setting anticipated deviation time Tttlc 
according to lane-def ining-line non-detection frequency 
such that anticipated deviation time Tttlc is decreased 

30 as the lane-def ining-line non-detection frequency 

increases, it becomes possible to properly decrease the 
frequency of the erroneous alarms . 
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[0126] Subsequently, there is discussed a second 
embodiment of the lane deviation alarm system. The 
second embodiment of the lane deviation alarm system 
basically has the same construction as the first 
5 embodiment has, as far as there is no specific 
explanation. 

[0127] Fig. 19 shows a procedure of the traveling 
condition monitor processing executed by controller 2 in 
the second embodiment according to the present invention. 

10 This processing basically corresponds to the processing 
shown in Fig. 10 in the first embodiment. In the 
processing shown in Fig. 19, instead of the process at 
step S40 in Fig 10 of the first embodiment, a lateral 
displacement threshold correcting processing at step S60 

is and an anticipated deviation time set processing at step 
S80 are newly executed. 

[0128] In the flowchart of Fig. 19, the contents of 

steps S21, S22, S30, S23-S26 and S50 are the same as 

those in the flowchart of Fig. 10 in the first embodiment, 

20 and therefore the explanation thereof is omitted herein. 
[0129] In the flowchart of Fig. 19 in the second 
embodiment, after the calculation processing of 
lane -defining- line non-detection frequency at step S30 is 
executed, the processing of setting the anticipated 

25 deviation time is executed at step S60. 

[0130] At step S60 controller 2 executes a processing 
of correcting or changing a deviation determination 
threshold. 

[0131] At step S80 subsequent to the execution of step 
30 S60, controller 2 varies (sets) the anticipated deviation 
time employed for calculating the forward- observed-point 
lateral- displacement . 
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[0132] Subsequently, steps S23-S26 and S50 are 
sequentially executed as same as the first embodiment. 
By executing these steps, controller 2 determines the 
lane deviation tendency of the vehicle and generates a 
5 deviation alarm on the basis of the determination result . 
Further, by executing the processing at steps S60 and S80, 
even in a case that the candidate points of the 
lane-defining- line are decreased by Botts Dots or patchy 
looking of the lane-defining- line and therefore the 
10 lane-defining- line non-detection frequency increases 
thereby, it becomes possible to stably generate the 
deviation alarms so as to decrease the erroneous alarms . 
This suppresses the driver from unnecessarily having a 
noisy feeling. 

15 [0133] Subsequently, there is discussed the deviation 
determination threshold correcting processing executed at 
step S60. Fig. 20 shows a procedure of the deviation 
determination threshold correction processing. This 
processing basically comprises a first half processing 

20 including steps S61 through S70 and a second half 
processing including steps S71 through S78. 
[0134] At step S61 controller 2 determines whether or 
not right line non-detection frequency Frh(t) obtained at 
step S30 is greater than a predetermined value such as 

25 0.8. When the determination at step S61 is affirmative, 
that is, when right line non-detection frequency Frh(t) 
is greater than the predetermined value such as 0.8, the 
program proceeds to step S62. When the determination at 
step S61 is negative, that is, when right line 

30 non-detection frequency Frh(t) obtained at step S30 is 

smaller than or equal to predetermined value such as 0.8, 
the program proceeds to step S66. 
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[0135] At step S62 controller determines whether or not 
left line non-detection frequency Flh(t) obtained at step 
S30 is greater than a predetermined value such as 0.8. 
When the determination at step S62 is affirmative, that 
5 is, when left line non- detection frequency Flh(t) is 
greater than the predetermined value such as 0.8, the 
program proceeds to step S63. When the determination at 
step S62 is negative, that is, when left line 
non-detection frequency Flh(t) obtained at step S30 is 

10 smaller than or equal to predetermined value such as 0.8, 
the program proceeds to step S64. A situation that the 
program proceeds to step S63 is a situation that both of 
right and left line non-detection frequencies Frh(t) and 
Flh(t) are greater than the predetermined value. A 

15 situation that the program proceeds to step S64 is a 

situation that only right line non-detection frequency 
Frh(t) is greater than the predetermined value. 
[0136] Although the second embodiment has been shown 
and explained such that the first predetermined value of 

20 the threshold is set at 0.8, it will be understood that 
the invention is not limited to this. The comparison 
between right line non-detection frequency Frh(t) and the 
predetermined value, and the comparison between left line 
non-detection frequency Flh(t) and the predetermined 

25 value are executed to determine the rate of detection of 
right line or left line. Accordingly, if the 
predetermined value certainly indicates that the decrease 
of the rate of the detection, it may take a value except 
for 0.8. For example, the predetermined value may be 

30 obtained from a running test with an actual vehicle. 

[0137] At step S63 controller 2 sets a state exchange 
variable CASE at 3 (CASE=3). This state exchange 
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variable CASE is used in the second half of the flowchart 
in Fig. 20. Thereafter, the program proceeds to step S71. 
[0138] At step S64 controller 2 determines whether or 
not anticipated deviation time Tttlc is 0. (herein, 
5 anticipated deviation time Tttlc is a value obtained at 
step S80 executed subsequent to the deviation 
determination threshold correcting processing at step S60. 
That is, at step S64 controller 2 determines whether or 
not anticipated deviation time Tttlc obtained in the 

10 previous processing of the whole processing in Fig. 19 is 
0. When the determination at step S64 is affirmative 
(Tttlc=0), the program proceeds to step S65. When the 
determination at step S64 is negative (Tttlc^O), the 
program proceeds to step S71. 

15 [0139] At step S65 controller 2 sets state exchange 
variable CASE at 2 (CASE=2). A situation that the 
program proceeds from step S64 to step S71 is a situation 
that anticipated deviation time Tttlc is not zero, and 
therefore under this situation the program proceeds to 

20 step S71 without changing state exchange variable CASE. 

[0140] On the other hand, at step S66 subsequent to the 
negative determination at step S61, controller 2 
determines whether or not left line non-detection 
frequency Flh(t) obtained at step S30 is greater than 

25 predetermined value such as 0.8. When the determination 
at step S66 is affirmative (Flh( t ) >0 . 8 ) , the program 
proceeds to step S67. When the determination at step S66 
is negative (Flh(t)^0.8) , the program proceeds to step 
S69. A situation that the program proceeds to step S67 

30 is a situation that only left line non-detection 

frequency Flh(t) is greater than the predetermined value. 
A situation that the program proceeds to step S69 is a 
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situation that both of right and left line non-detection 
frequencies Frh(t) and Flh(t) are smaller than the 
predetermined value. 

[0141] At step S67 controller 2 determines whether or 
5 not anticipated deviation time Tttlc is 0. Herein, 
anticipated deviation time Tttlc is the same as 
anticipated deviation time Tttlc employed in step S64. 
That is, it is the anticipated deviation time Tttlc 
calculated at step S80 which is executed subsequently to 

10 the deviation determination threshold correcting 
processing at step S60 . At step S80 controller 
determines whether or not anticipated deviation time 
Tttlc calculated in the previous main routine cycle is 0. 
When the determination at step S67 is affirmative 

15 (Tttlc=0), the program proceeds to step S68. When the 
determination at step S67 is negative (Tttlc^O), the 
program proceeds to step S71. 

[0142] At step S68, controller 2 sets state exchange 
variable CASE at 2 (CASE=2). Thereafter, the program 

20 proceeds to step S71. A situation that the program 

proceeds from step S67 to step S71 is a situation that 
anticipated deviation time Tttlc is not 0. Under this 
situation, the program proceeds to step S71 without 
changing state exchange variable CASE. 

25 [0143] On the other hand, at step S69 controller 2 
determines whether right line non-detection frequency 
Frh(t) is smaller than a predetermined value such as 0.5 
and whether left line non-detection frequency Flh(t) is 
smaller than a predetermined value such as 0.5. When the 

30 determination at step S69 is affirmative, that is, when 

right line non-detection frequency Frh(t) is smaller than 
the predetermined value such as 0.5 and when left line 
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non-detection frequency Flh(t) is smaller than the 
predetermined value such as 0.5, the program proceeds to 
step S70. The affirmative determination at step S69 
represents that both of right and left line non-detection 
frequencies are recovered. When the determination at 
step S69 is negative, the program proceeds to step S71. 
Herein, the predetermined value is set to have a 
hysteresis with respect to the predetermined value such 
as 0.8 employed at steps S61, S62 and S66. 
[0144] Although the second embodiment has been shown 
and explained such that the second predetermined value of 
the threshold is set at 0.5, it will be understood that 
the invention is not limited to this. The comparison 
between right line non-detection frequency Frh(t) and the 
second predetermined value, and the comparison between 
left line non-detection frequency Flh(t) and the second 
predetermined value are executed to determine the 
recovery of~the rate of - detection ofTight line rox - lef t~ 
line. Accordingly, if the second predetermined value 
certainly indicates that the recovery of the rate of the 
detection or if it certainly indicates that the output 
signal of camera system 1 is, stable, it may take a value 
except for 0.5. For example, the second predetermined 
value may be obtained from a running test with an actual 
vehicle. 

[0145] At step S70 controller 2 sets state exchange 
variable CASE at 0 (CASE=0), and thereafter the program 
proceeds to step S71. In case that the program proceeds 
from step S69 to step S71, the program proceeds to step 
S71 without changing state exchange variable CASE. 
[0146] In the processing executed at steps S71 through 
S78 discussed hereinafter, controller 2 determines the 



P03NM- 125/02-01134 



-47- 

value of state exchange variable CASE obtained in the 
first half processing and executes a setting of the 
deviation determination threshold according to the 
determination result. 
5 [0147] At step S71, controller 2 determines whether or 
not state exchange variable CASE is greater than 2 . When 
the determination at step S71 is affirmative (CASE>2), 
the program proceeds to step S75. When the determination 
at step S71 is negative (CASE^2), the program proceeds to 
10 step S72. 

[0148] At step S72 controller 2 determines whether or 
not state exchange variable CASE is equal to 1. When the 
determination at step S72 is affirmative (CASE=1), the 
program proceeds to step S76. When the determination at 
15 step S72 is negative (CASE^l), the program proceeds to 
step S73. 

[0149] At step S73 controller 2 determines whether or 
not state exchange variable CASE is equal to 2 . When the 
determination at step S73 is affirmative (CASE=2), the 
20 program proceeds to step S77. When the determination at 
step S73 is negative (CASE*2), the program proceeds to 
step S78. 

[0150] With this programming from step S71 to step S73, 
when state exchange variable CASE is equal to 0 (CASE=0), 

25 the program proceeds to step S78. When state exchange 
variable CASE is equal to 1 (CASE=1), the program 
proceeds to step S76. When state exchange variable CASE 
is equal to 2 (CASE=2), the program proceeds to step S77. 
When state exchange variable CASE is equal to 3 (CASE=3), 

30 the program proceeds to step S75. 

[0151] That is, the update of the deviation 
determination threshold is executed through the execution 
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of steps S75 through S78. More specifically, the 
processing of step S75 is executed when both of right and 
left line non-detection frequencies Frh(t) and Flh(t) are 
high (CASE=3). Accordingly, at step S75 controller 2 
5 sets both of right deviation determination threshold 

Yth_r and left deviation determination threshold Yth_l at 
Yth3 which is the largest value. 

[0152] The processing at step S7 6 is executed when 
right line non-detection frequency Frh(t) is high and 

10 anticipated deviation time Tttlc is 0 (CASE=1). 
Accordingly, at step S76 controller 2 sets right 
deviation determination threshold Yth_r at Yth3 and 
increases left deviation determination threshold Yth_l by 
a quantity Athl so as to gradually correct left deviation 

15 determination threshold Yth_l to a larger value. Herein, 
the increasing correction of left deviation determination 
threshold Yth_l is executed until left deviation 
determination threshold Yth_l reaches a threshold Yth2 . 
The threshold Yth2 is larger than a normal threshold Ythl 

20 which is an initial value, and is smaller than the 
threshold Yth3 which is employed in case that the 
non-detection frequency is the largest. 

[0153] The processing at step S77 is executed when left 
line non-detection frequency Flh(t) is high and 

25 anticipated deviation time Tttlc is 0 (CASE=2). 

Accordingly, at step S77 controller 2 sets left deviation 
determination threshold Yth_l at Yth3 and increases right 
deviation determination threshold Yth__r by quantity Athl 
so as to gradually correct right deviation determination 

30 threshold Yth_r to a larger value. Herein, the 

increasing correction of right deviation determination 
threshold Yth_r is executed until right deviation 
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determination threshold Yth_r reaches threshold Yth2 
where Ythl<Yth2<Yth3 . The threshold Yth2 is larger than 
normal threshold Ythl which is an initial value, and is 
smaller than the threshold Yth3 which is employed in case 
5 that the non-detection frequency is the largest. 

[0154] The processing of step S78 is executed when both 
of right and left line non-detection frequencies Frh(t) 
and Flh(t) are low and therefore the line detecting 
condition is stable (CASE=0). Accordingly, at step S78 

10 controller 2 decreases both of right and left deviation 
determination thresholds Yth_r and Yth_l by quantity Ath2 
so as to gradually correct right and left deviation 
determination thresholds Yth_r and Yth_l to a larger 
value. Herein, the increasing correction of right 

15 deviation determination threshold Yth_r is executed until 
right and left deviation determination thresholds Yth_r 
and Yth_l reach the initial threshold Ythl. As discussed 
above, the deviation determination threshold correcting 
processing at step S60 is executed. 

20 [0155] Subsequently, there is explained an anticipated 
deviation time set processing executed at step S80 with 
reference to a flowchart shown in Fig. 21. 

[0156] At step S81 controller 2 selects the largest one 
of right line non-detection frequencies Frh(t) and the 

25 largest one of left line non-detection frequencies Flh(t), 
which are calculated at step S30 corresponding to steps 
S31 through S33. Further, controller 2 compares the 
selected right line non-detection frequency Frh(t) and 
the selected left line non-detection frequency Flh(t). 

30 Herein, when right line non- detection frequency Frh(t) is 
greater than left line non-detection frequency Flh(t), 
the program proceeds to step S82. When right line 
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non- detection frequency Frh(t) is small than or equal to 
left line non-detection frequency Flh(t), the program 
proceeds to step S83. 

[0157] At step S82 controller 2 calculates anticipated 
5 deviation time target value Tttlc' using the following 
expressions ( 40 ) . 

When Frh(t)<Flo, Tttlc ' =Tttlcl . 
When Flo^Frh(t)<Fhi, 

Tttlc '=Tttlcl*( (Fhi-Frh(t) )/(Fhi-Flo) ) . 
10 When Fhi^Frh(t), Tttlc' =0. 

---(40) 

[0158] At step S83 controller 2 calculates anticipated 
deviation time target value Tttlc' using the following 
expressions (41) 
15 When Flh(t)<Flo, Tttlc ' =Tttlcl . 

When Flo^Flh(t)<Fhi, 

Tttic-=Ttt-le^ ■ 

When Fhi^Flh(t), Tttlc'=0. 

---(41) 

20 [0159] The processing subsequent to the execution of 

step S82 or S83 is executed according to a value of state 
exchange flag flag_c. The relationship between the state 
exchange flag flag_c and the processed content is as 
follows • 

25 [0160] When flag_c=0, controller 2 executes a 

processing after updated anticipated deviation time Tttlc 
corresponds to anticipated deviation time target value 
Tttlc' in the anticipated deviation time setting 
processing. When flag_c=l, controller 2 executes a 

30 processing of maintaining anticipated deviation time 

Tttlc without newly updating anticipated deviation time 
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Tttlc. When flag__c=2, controller 2 executes a processing 
of gradually approaching anticipated deviation time Tttlc 
to anticipated deviation time target value Tttlc' by 
increasing anticipated deviation time Tttlc by a quantity 
5 Atl or by decreasing anticipated deviation time Tttlc by 
a quantity At2. 

[0161] At step S84 subsequent to the execution of step 
S82 or S83, controller 2 determines whether or not state 
exchange flag flag_c is 0. When flag_c=0, the program 
10 proceeds to step S86. When flag_c*0, the program 
proceeds to step S85. 

[0162] At step S86 controller 2 executes a processing 
executed after anticipated deviation time Tttlc once 
corresponds to anticipated deviation time target value 

15 Tttlc'. More specifically, controller 2 updates by 

setting anticipated deviation time target value Tttlc' at 

anticipated deviation time Tttlc, so that anticipated 

deviation time always corresponds to anticipated 
deviation time target value Tttlc' in the processing 

20 thereafter. 

[0163] At step S88 subsequent to the execution of step 
S86, controller 2 determines whether or not anticipated 
deviation time Tttlc reaches 0 as a result of the 
decreasing. When anticipated deviation time Tttlc is 

25 equal to 0 (Tttlc=0), the program proceeds to step S89 

wherein controller 2 sets state exchanging flag flag_c at 
0 (flag_c=0). As will discussed later, the processing 
executed when flag_c=0 is a processing of maintaining 
anticipated deviation time Tttlc without updating 

30 anticipated deviation time Tttlc. Therefore, when at 
step S89 state exchanging flag flag_c is 6et at 1, the 
processing executed thereafter is executed on the 
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presumption that anticipated deviation time Tttlc is 
maintained. After the execution of step S89, the 
processing shown in Fig. 21 is terminated. 
[0164] At step S85 subsequent to the negative 
5 determination at step S84, controller determines whether 
or not state exchanging flag flag_c is 1. When flag_c=l # 
the program proceeds to step S90. when flag_c*l, that is, 
when flag_ c=2, the program proceeds to step S87. 
[0165] The processing of steps S85 and S90 is a 

10 processing of proceeding without updating anticipated 
deviation time Tttlc but maintaining anticipated 
deviation time Tttlc. At step S90 controller 2 
determines whether or not at least one of right and left 
deviation determination thresholds Yth_r and Yth_l 

15 recovers to initial threshold Ythl. 

[0166] At step S78 (CASE=0) during the deviation 
determination threshold correction processing of step S60, 
when the lane-def ining-line detecting condition is stableT 
both of right and left deviation determination thresholds 

20 Yth_r and Yth_l are decreased by quantity Ath2 until both 
of right and left deviation determination thresholds 
Yth_r and Yth_l reach initial threshold Ythl. 
[0167] Due to the above correction processing, the 
determination at step S90 determines whether right 

25 deviation determination threshold Yth__r or left deviation 
determination threshold Yth_l recovers to initial 
threshold Ythl. When the determination at step S90 is 
affirmative, that is, when right deviation determination 
threshold Yth_r or left deviation determination threshold 

30 Yth_l recovers to initial threshold Ythl (Yth_r=l or 
Yth_l=l), the program proceeds to step S91 wherein 
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controller 2 sets state exchange flag flag_c at 2 
(flag_c=2) . 

[0168] As will be discussed later, the processing (step 
S87) in case of flag_c=2 is a processing of bringing 
anticipated deviation time Tttlc closer to anticipated 
deviation time target value Tttlc' by increasing 
anticipated deviation time Tttlc by quantity Atl or 
decreasing anticipated deviation time Tttlc by quantity 
At2. 

[0169] At step S87 subsequent to the negative 
determination at step S85, controller 2 updates 
anticipated deviation time Tttlc using the following 
expressions ( 42 ) . 

When Tttlc^Tttlc'-Atl, 

Tttlc=Tttlcl+Atl . 
When Tttlc '+At2^Tttlc, 

Tttlc=Tttlcl - Atr: - — 

When | Tttlc' -Tttlc | <At( Atl or At2), 
Tttlc=Tttlc' • 

---(42) 

[0170] As discussed above, at step S87, controller 2 
executes the processing of bringing anticipated deviation 
time Tttlc closer to anticipated deviation time target 
value Tttlc' by increasing anticipated deviation time 
Tttlc by quantity Atl or decreasing anticipated deviation 
time Tttlc by quantity At2. Further, a processing of 
setting anticipated deviation time Tttlc at target value 
Tttlc' (Tttlc=Tttlc' ) in case of | Tttlc ' Tttlc | < At (Atl or 
At2) is a processing for smoothly justifying anticipated 
deviation time Tttlc at target value Tttlc' 
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(Tttlc=Tttlc ' ) after anticipated deviation time Tttlc is 
increased by quantity Atl or decreased by quantity At2. 
[0171] At step S92 controller 2 determines whether or 
not anticipated deviation time Tttlc corresponds to 
5 anticipated deviation time Tttlc' (Tttlc=Tttlc ' ? ) . When 
Tttlc=Tttlc' , that is, when the justifying processing is 
executed at step S87, controller 2 sets state exchanging 
flag flag_c at 0 (flag_c=0). Thereafter, the processing 
of updating anticipated deviation time Tttlc at target 
10 value Tttlc' (processing of steps S84 and S86) is 
executed. 

[0172] With the execution of the lateral displacement 
determination threshold correcting processing of step S60 
and the anticipated deviation time setting processing of 

is S60, when the lane-def ining-line non-detection frequency 
is increasing, anticipated deviation time Tttlc is 
corrected to approach 0 and right deviation determination 
threshold Yth_r and left deviation determination 
threshold Yth_l are increased after anticipated deviation 

20 time Tttlc reaches 0. Further, when the 

lane-def ining-line non-detection frequency is decreasing, 
that is, when the lane-def ining-line detection frequency 
is increasing, both of right deviation determination 
threshold Yth_r and left deviation determination 

25 threshold Yth_l are corrected so as to become initial 

threshold Ythl. Additionally, when one of right and left 
deviation determination thresholds Yth_r and Yth_l 
recovers to initial threshold Ythl, anticipated deviation 
time Tttlc is corrected so as to become initial 

30 anticipated deviation time Tttlcl . 

[0173] Subsequently, there is discussed a function and 
operation of the traveling condition monitor processing 
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with reference to timing charts shown in Figs. 22A 
through 2H. 

[0174] Fig. 22A shows a change of left line 
non-detection flag flag_l indicative of a left 
5 lane-def ining-line detection condition picked up by 

camera system 1. Fig. 22B shows a change of right line 
non-detection flag flag_r indicative of a right 
lane-def ining-line detection condition picked up by 
camera system 1. 

10 [0175] In this embodiment, it is assumed that the 

non-detection of the right lane-def ining-line continues 
for a relatively long time as shown in Fig. 22B. Under 
this condition, right line non-detection flag flag_r 
takes 0 and 1 for a long time. 

15 [0176] In the lane-def ining-line non-detection 

frequency calculation processing executed at step S30, 
right lane-def ining-line non-detection frequency Frh, 
which is calculated by the moving average processing of 
right lane-def ining-line non-detection flag flag_r during 

20 the predetermined period, is varied as shown in Fig. 22C. 
In this embodiment, right line non-detection frequency 
Frh increases to 1 as shown in Fig. 22C when right line 
non-detection state by camera system 1 continues. 
[0177] In the anticipated deviation time set processing 

25 executed at step S80, controller 2 sets anticipated 

deviation time Tttlc on the basis of right or left line 
non-detection frequency Frh or Flh. In this second 
embodiment, since right line non-detection frequency Frh 
is higher than left line non- detection frequency Flh, 

30 controller 2 sets anticipated deviation time Tttlc on the 
basis of right line non-detection frequency Frh. Since 
anticipated deviation time Tttlc is calculated so as to 
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be in proportion to right line non-detection frequency 
Frh as is apparent from the expression (40), anticipated 
deviation time Tttlc is varied as shown in Fig. 22D. 
More specifically, anticipated deviation time Tttlc 
5 starts to decrease from fixed value Tttlcl which is an 
initial value as right line non-detection frequency Frh 
increases. When right line non-detection frequency Frh 
reaches 1, anticipated deviation time Tttlcl takes 0 
(Tttlcl=0=Tttlc f ) at step S87. 

10 [0178] In the anticipated deviation time setting 
processing of step S80, as is similar to the first 
embodiment, anticipated deviation time Tttlc is set on 
the basis of lane-def ining-line non-detection frequencies 
Frh and Flh. Further, particularly in this second 

15 embodiment, anticipated deviation time target value 
Tttlc' is previously set on the basis of right line 
non-detection frequency Frh or left line non-detecting 
frequency Flh, and anticipated deviation time Tttlc is 
justified at the anticipated deviation time target value 

20 Tttlc'. 

[0179] On the other hand, in the deviation 
determination threshold correcting processing at step S60, 
with reference to a one-cycle before anticipated 
deviation time Tttlc set on the basis of right line 

25 non-detection frequency Frh or left line non-detecting 
frequency Flh in the anticipated deviation time setting 
processing, when anticipated deviation time Tttlc reaches 
0, deviation determination threshold Yth__ r and Yth_l are 
increased by executing steps S75 through S77. This 

30 arrangement suppresses a change of start timing of the 

alarm during a period from a moment of starting the line 
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non-detection state to a moment when a predetermined time 
elapsed from the start. 

[0180] In the second embodiment, as shown in Fig. 22E, 
at a moment when anticipated deviation time Tttlc reaches 
5 0, right line deviation determination threshold Yth_r of 
a line non-detection side is set at largest threshold 
Yth3, and left line deviation determination threshold 
Yth_l of a line detection side is changed from smallest 
threshold Ythl to intermediate threshold Yth2 by the 

10 execution of step S76. 

[0181] In the deviation threshold correcting 
processing at step S60, when both of right and left line 
non-detection frequencies increase to the predetermined 
value, by decreasing both of right and left deviation 

15 determination thresholds Yth_r and Yth_l by quantity Ath2 
as shown in Fig. 22E, right and left deviation 
determination thresholds Yth_r and Yth_l are corrected 
until they reach initial threshold Ythl through the 
execution of step S87. 

20 [0182] As a result, when right and left deviation 

determination thresholds Yth_r and Yth_l reach initial 
threshold Ythl, anticipated deviation time Tttlc is 
corrected to 1 (target value Tttlc') by the anticipated 
deviation time set processing of step S80 and 

25 particularly by the execution of step S87, as shown in 
Fig. 22D. 

[0183] The second embodiment according to the present 
invention is arranged to execute the anticipated 
deviation time setting processing at step S80 after the 
30 deviation determination threshold correcting processing 
at step S60 is executed, as shown in Fig. 19. This 
arrangement has a function that in case that the 
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lane-def ining-line detection state is recovered from a 
non-detection state of one lane-def ining-line to a 
detection state of both lane-def ining-lines , anticipated 
deviation time Tttlc is varied to the anticipated 
5 deviation time Tttlcl which is employed when both 
lane-def ining-lines are detected, after deviation 
determination threshold (in this embodiment, a deviation 
determination threshold of a line detected side under a 
condition that one of the lane-def ining-lines is in 

10 non-detection state) reached the normal deviation 

threshold Ythl. By this arrangement, as shown in Fig. 
22E, when the lane-def ining-line detection state is 
recovered from a non-detection state of one 
lane-def ining-line to a detection state of both 

15 lane-def ining-lines, both of right and left deviation 

determination thresholds Yth_r and Yth_l are recovered to 
initial deviation determination threshold Ythl. Further, 
subsequently to this recovery, anticipated deviation time 
Tttlc is recovered to initial anticipated deviation time 

20 Tttlcl as shown in Fig. 22D. 

[0184] As discussed above, the second embodiment is 
arranged such that when both of line non-detection 
frequencies Frh and Flh become high, the anticipated 
deviation time Tttlc is gradually decreased to 0 by 

25 executing the deviation determination threshold 

correcting processing at step S80. Further, when 
anticipated deviation time Tttlc reaches 0 (a 
predetermined value), deviation determination thresholds 
Yth_r and Yth_l are changed to a large value by executing 

30 the deviation determination threshold correcting 
processing of step S60. 
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[0185] Subsequently, there is discussed the advantages 
gained by the second embodiment according to the present 
invention. 

[0186] Even when the detection and the non-detection 
5 of the lane-def ining-line by camera system 1 are 

alternately repeated, a processing for correcting an 
estimated value of the road parameters toward a correct 
value every time camera system 1 detects the 
lane-defining line. As a result, the influence of the 

10 line non-detection state by camera system 1 is not 

accumulated as an estimated value of the road parameter 
which includes a vehicle state quantity such as lateral 
displacement y cr and yaw angle fa. Therefore, even if one 
of the lane defining lines is transiently put in the 

15 non-detection state, no erroneous alarm is generated. 
[0187] However, when the non-detection state of the 
one lane defining line continues for a predetermined time 
period, the actual vehicle condition is put in a 
different state. For example, when the vehicle speed 

20 changes (increases), the vehicle receives aerodynamic 

lift due to the air flow which increases as the vehicle 
speed becomes higher. This varies the vehicle height and 
camera height h. Further when the vehicle is accelerated 
or decelerated, a direction of a vehicle front portion 

25 changes. For example, during the vehicle acceleration, 
the vehicle front portion is angled in the upward 
direction, and during the vehicle deceleration, the 
vehicle front portion is angled in the downward direction. 
Thus, when the direction of the vehicle front portion is 

30 changed due to the vehicle acceleration/deceleration 

operation, both of pitch angle a and camera height h are 
varied . 
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[0188] Thus, since camera height h varies according to 
the change of the vehicle speed or the 

acceleration/deceleration operation, it is necessary to 
take account of such a change of camera height h when the 
5 non-detection state of one lane defining line continues 
for the predetermined time. More specifically, the 
change of camera height h steadily affects the estimated 
values of the road parameters. If the estimated value of 
lateral displacement y cr varies, the frequency of the 
10 erroneous alarms will increase, and the driver will feel 
it noisy. 

[0189] Fig. 22F shows a time- series change of lateral 
displacement y cr which is estimated while including the 
change of camera height h due to the vehicle speed change 

15 or acceleration/deceleration operation in a case that the 
non-detection state of one lane defining line continues 
for a predetermined long time. Further, when the 
non-detection state of one lane defining line continues, 
it is difficult to correctly estimate yaw angle <pr and 

20 therefore yaw angle <pr fluctuates as shown in Fig. 22G. 

Under this condition, if the lane deviation determination 
is executed on the basis of anticipated deviation time 
Tttlc and deviation determination threshold Ythl which 
are used when both of the lane-defining- lines are 

25 detected, forward- observed-point lateral -displacement 

estimated value y s (y s =Ycr+(VxTttlc)0t) largely fluctuate 
with respect to deviation determination threshold Ythl , 
and increases its fluctuation amplitude due to the change 
of camera height h. Consequently, the frequency of 

30 erroneous alarms increases . 

[0190] Subsequently, if deviation determination 
thresholds Yth_r and Yth_l are maintained at Ythl and 
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anticipated deviation time Tttlc is corrected toward 0, 
the change of forward-observed-point lateral-displacement 
y s becomes slow and stable as compared with the case of 
no-correction of anticipated deviation time Tttlc, as 
5 discussed in the first embodiment. However, the change 
of forward- observed-point lateral-displacement estimated 
value y s is largely influenced by lateral displacement 
estimated value y cr . For example, as is apparent from the 
expression (30), even if anticipated deviation time Tttlc 
10 is corrected to a smaller value, lateral displacement 
estimated value y cr affects forward- observed-point 
lateral-displacement estimated value y s . Accordingly, it 
is difficult to prevent the generation of the erroneous 
alarm. 

15 [0191] On the other hand, if anticipated deviation 
time Tttlc is maintained at Tttlcl and deviation 
determination thresholds Yth_r and Yth_l are corrected to 
a larger value upon taking account of lateral 
displacement estimated value y cr , it is possible to 

20 decrease the frequency of erroneous alarms. However, in 
case that deviation determination thresholds Yth_jr and 
Yth_l are corrected to decrease the erroneous alarm 
generated by the error of lateral displacement estimated 
value y cr , a margin of the threshold set by the correction 

25 is used to decrease the frequency of the erroneous alarms 
generated by the fluctuation of yaw angle estimated value 
<pr. Accordingly, in case that yaw angle estimated value 
<pr also fluctuates in addition to the fluctuation of 
lateral displacement estimated value y cr . it is necessary 

30 to correct deviation determination thresholds Yth_r and 
Yth_l at excessively large values. Therefore, the 
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control width of properly adjusting the alarm timing 
becomes very narrow. 

[0192] Taking account of the above operations, the 
second embodiment according to the present invention is 
5 arranged such that when the line non- detection frequency 
Frh or Flh becomes high, anticipated deviation time Tttlc 
is gradually decreased toward 0 by the execution of the 
anticipated deviation time set processing of step S80, 
and when anticipated deviation time Tttlc reaches the 
10 predetermined value (0), deviation determination 

thresholds Yth_r an Yth_l are changed to larger values by 
the execution of the deviation determination threshold 
correcting processing at step S60. 

[0193] With this arrangement of the second embodiment 
15 according to the present invention, even when the 

non-detection state of one lane-def ining-line continues 
for a long time, anticipated deviation time Tttlc is 
gradually decreased to a smaller value toward 0 by 
executing the anticipated deviation time setting 
20 processing at step S80, during the initial period of the 
non-detection state of the one lane-def ining-line. This 
properly decreases a rate of yaw angle component , which 
largely fluctuates , with respect to 

forward-observed-point lateral- displacement estimated 
25 value y s . Further, when anticipated deviation time Tttlc 
reaches the predetermined ( 0 in this embodiment ) , 
deviation determination thresholds Yth_r and Yth_l are 
changed to the larger values by executing the deviation 
determination threshold correcting processing at step S60. 
30 Consequently, this arrangement removes the error of 

lateral displacement estimated value y cr . That is, the 
second embodiment is arranged to correct the deviation 
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determination threshold (lateral displacement 
determination threshold) to a large value for the purpose 
of decreasing the frequency of the erroneous alarms with 
respect to the fluctuation of yaw angle estimated value <pr 
5 and the error of lateral displacement y cr - Further, 
taking account of a timing of generating an error of 
lateral displacement estimated value y cr , a timing of 
correcting the deviation determination threshold (lateral 
displacement determination threshold) at the large value 
10 is delayed at a timing that a predetermined time elapses 
from the non-detection state of the one lane-defining 
line. 

[0194] With this arrangement, it becomes possible to 
prevent the erroneous alarm generated by the large 

15 fluctuation of the yaw angle estimated value, and to 

prevent the erroneous alarm generated by the error of the 
lateral displacement estimated value y cr . This prevents 
the driver from having a noisy feeling of the alarm. 
[0195] In the second embodiment, deviation 

20 determination thresholds Yth_r and Yth_l corresponding to 
both adjacent lanes are corrected. The deviation 
determination threshold of the detected line is also 
corrected. 

[0196] For example, in case that the vehicle travels a 
25 line adjacent portion, if camera height h fluctuates due 
to the vehicle speed variation or 

acceleration/deceleration operation, lateral displacement 
estimated value y cr fluctuates. As a result, the start 
and stop of the alarm are repeated, and unnecessary alarm 
30 may be generated. In order to prevent such unnecessary 
alarm, the deviation determination threshold at a line 
detection side is also corrected. This correction 
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prevents such unnecessary alarm even if camera height h 
fluctuates . 

[0197] Further, the deviation determination threshold 
at the line detected side is set at a value smaller than 
5 that of the deviation determination threshold at the line 
non-detection side. That is, at the non-detection side, 
the position of the actual lane defining line is unstable, 
and therefore a criteria for determining the alarm 
generating timing based on the vehicle position is also 

10 ambiguous. Accordingly, in order to certainly prevent 
the erroneous alarm, the deviation determination 
threshold at the line non-detection side is set at the 
large value. In other words, since the frequency of the 
erroneous alarms at the line detected side is certainly 

15 smaller than that of the line non-detection side, it is 
possible to suppress the deviation determination 
threshold small. This suppresses the unnecessary alarm 
while maintaining the alarm function. 

[0198] A start timing of the deviation alarm in case 
20 of the one- line non-detection state may slightly delay as 
compared with a start timing of the deviation alarm of 
the both-lines detected state. This delay may degrade 
the performance of the start timing. However, this 
arrangement decreases the noisy feeling while maintaining 
25 the alarm function. 

[0199] It is clear from the expressions (14) through 
(17) that the coordinates at the non-detection line 
candidate point does not affect the error evaluating 
function for calculating fluctuation quantities Aa 
30 through Ae. That is, fluctuation quantities Aa through 
Ae calculated using the expression (24) are correction 
quantities for decreasing an error between the actual 
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line position and the position obtained from the model 
line using the estimated road parameters a through e, as 
possible. When the coordinates of the non-detection 
point is not clear, K ±i =0 is forcibly set. Accordingly, 
5 this does not affect the value of column vector S K in the 
expression (14), and therefore fluctuation quantities Aa 
through Ae are calculated from the detected line 
candidate point. 

[0200] As a state that the number of the line 
10 candidate points of one side is extremely small, the 
following states are considered. 

(1) A state that detected line candidate points are only 
points located considerably far from the host vehicle. 

(2) A state that detected line candidate points are only 
15 points located considerably near the host vehicle. 

(3) A state that detected line candidate points are only 
points between the states (1) and (2). 

[0201] Under these states, a rate of the influence on 
the error performance function becomes unbalanced at the 

20 detected side. Accordingly, in the expression (22), 

column vector S K is calculated at the side where the lot 
of line candidate points are detected. As a result, 
fluctuation quantities Aa through Ae calculated by the 
expression (24) are also affected by the error of the 

25 intensively detected side. Thus, when the number of line 
candidate points of one line is extremely smaller than 
the number of line candidate points of the other line, 
the correction is executed based on the coordinates of 
the line candidate points having a high detection rate. 

30 As a result, the line candidate points at the 

low-detection rate side is strongly influenced by the 
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error of the high-detection rate side. Therefore, the 
road parameters steadily generate an error, 
[0202] Further, since the second embodiment has been 
arranged to add the expression (17) to the error 
5 performance function so as to smoothly move the road 

parameters along the time-axis, the non-detection of the 
line candidate point affects fluctuation quantities Aa 
through Ae, in the strict sense. However, the influence 
of the non- detection decreases toward 0 as the time 

10 elapses. Accordingly, if a state that the number of the 
line candidate points at the non-detection side is very 
small continues for a time, the influence on the 
fluctuation quantities Aa through Ae becomes almost zero. 
[0203] On the other hand, using the road parameters 

15 obtained from a line model, forward-observed-point 

lateral -displacement estimated value y s is calculated 
referring to the expression (30). Therefore, when the 
number of the line candidate points at one side is 
extremely small, the road parameters steadily generate 

20 errors . Forward-observed-point lateral-displacement 

estimated value y s includes errors due to the steady error 
of the road parameters. However, since right and left 
deviation determination thresholds Yth_r and Yth_l 
corresponding to both adjacent lanes are corrected, it 

25 becomes possible to decrease the erroneous alarm. 

Specifically, by determining right and left deviation 
determination thresholds Yth_r and Yth_l taking account 
of the error, the reduction of the erroneous alarm is 
further effectively achieved. 

30 [0204] If the detecting line candidate points are not 
0 and steadily 1 or more, the steady error in the road 
parameters greatly becomes small as compared with the 
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completely non-detection state. Therefore, even when 
deviation determination thresholds Yth__ r and Yth_l are 
changed taking account of the error, the changed quantity 
thereof extremely becomes small. As a result, further 
5 effectively, erroneous alarm is decreased. 

[0205] Although the invention has been shown and 
described by explaining the first and second embodiments, 
the invention is not limited to these explanations . For 
example, when a setting of a picking-up condition of 

10 camera system 1 is changed, anticipated deviation time 
Tttlc may be set at a small value. Herein, the 
picking-up condition includes an exposure control set in 
response to the change of photo - environment , a shutter 
speed and the like. 

15 [0206] When the photo -environment fluctuates, a 

brightness level of an image picked-up by camera system 1 
also fluctuates. As a result, there causes a possibility 
that a detection condition of a lane defining line is 
degraded thereby. Accordingly, when the setting of the 

20 exposure control and the shutter speed are changed, 

anticipated deviation time Tttlc has been previously set 
at a smaller value in anticipation of the fluctuation of 
photo - environment . That is, by setting anticipated 
deviation time Tttlc at a smaller value at an early stage 

25 before the detection condition of the lane-defining line 
degrades, it becomes possible to suppress the fluctuation 
of forward- observed-point lateral-displacement y s at an 
early stage, even when one of the lane defining lines is 
not detected. This decreases the frequency of the 

30 erroneous alarms, and therefore decreases the noisy 
feeling applied to the driver. 
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[0207] Further, when a high frequency of the 
non-detection continues for a relatively long time, the 
alarm function of the non-detection side is stopped, that 
is, alarm device 7 stops the determination of the lane 
5 deviation tendency based on the lane defining line of the 
non-detection side and informs the driver of the stopping 
state of the alarm function. By this arrangement, under 
a condition that a criteria for determining a timing of 
generating alarm in relation to the vehicle position is 

10 not determined, alarm device 7 certainly stops the alarm 
as far as the vehicle travels within the traveling lane. 
This arrangement prevents unnecessary alarms which 
applies noisy feeling to the driver and certainly informs 
the inoperative state of alarm device 7 to the driver. 

15 [0208] Further, the second embodiment according to the 
present invention is arranged to correct deviation 
determination thresholds Yth_r and Yth_l for the purpose 
of decreasing the frequency of erroneous alarms. For 
example, deviation determination thresholds Yth__r and 

20 Yth_l may be increased as the lane-def ining-line 

non-detection frequency increases. Although the second 
embodiment according to the present invention has been 
shown and described such that the camera system 1 has an 
image picking-up function and an image processing 

25 function, the invention is not limited to this. That is, 
the image processing function may be executed by other 
system. For example, controller 2 may have the image 
processing function and executes the image processing of 
the images picked-up by camera system 1 . 

30 [0209] In the explanation of the preferred embodiments 
according to the present invention, the processing shown 
in Fig. 3, which is executed by the image processing 
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f unction of camera system 1, constructs yaw angle 
detecting means for detecting the yaw angle of host 
vehicle 10 on the basis of both lane defining lines 
detected by lane-def ining-line detecting means of camera 
5 system 1. As is clear from the processing in Fig. 3, 

camera system 1 obtains yaw angle <pr as a road parameter. 
[0210] The processing at step S23 of Fig. 10 executed 
by controller 2 constructs forward-observed-point 
calculating means for calculating the 

10 forward-observed-point by multiplying the vehicle speed 
and the predetermined anticipated deviation time. The 
processing at step S24 of Fig. 10 executed by controller 
2 constructs forward- observed-point lateral -displacement 
calculating means for calculating the 

15 forward-observed-point lateral -displacement on the basis 
of the yaw angle detected by the yaw angle detecting 
means and the forward-observed-point calculated by the 
forward-observed-point calculating means. The processing 
at step S50 of Fig. 10 executed by controller 2 

20 constructs lane deviation tendency determining means for 
determining whether the host vehicle is in a lane 
deviation tendency, on the basis of the 

forward- observed-point lateral -displacement calculated by 
the forward-observed-point lateral- displacement 

25 calculating means. Alarm device 7 constructs lane 

deviation tendency informing means for informing the lane 
deviation tendency of the host vehicle on the basis of 
the determination result of the lane deviation tendency 
determining means. 

30 [0211] The processing at step S40 (Fig. 12) in Fig. 10 
executed by controller 2 constructs criteria changing 
means for changing a criteria of the lane deviation 
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tendency of the host vehicle with respect to the lane 
deviation lines, on the basis of the detecting condition 
of the lane-defining- lines detected by the 
lane-def ining-line detecting means. More specifically, 
5 when the lane-def ining-line detecting means can detect 
only one of the lane defining lines, the criteria 
changing means changes the anticipated deviation time so 
as to decreases the influence of the yaw angle on the 
calculation of the forward-observed-point 

10 lateral-displacement . 

[0212] As is apparent from the explanation of the 
first and second embodiments, the detection of the 
lane-def ining-line and the non-detection of the 
lane-def ining-line are determined on the basis of the 

15 line detection processing based on the picked-up image, 
and are different from an existence of the 
lane-def ining-line and an absence of the 
lane-def ining-line. 

[0213] This application is based on Japanese Patent 
20 Application No. 2003-65424 filed on March 11, 2003 in 
Japan. The entire contents of this Japanese Patent 
Application are incorporated herein by reference. 
[0214] Although the invention has been described above 
by reference to certain embodiments of the invention, the 
25 invention is not limited to the embodiments described 
above. Modifications and variations of the embodiments 
described above will occur to those skilled in the art, 
in light of the above teaching. The scope of the 
invention is defined with reference to the following 
30 claims . 



